Article Text
Abstract
Objectives To identify currently available functional vision tests and evaluate their use as clinical trial outcome measures in ophthalmology.
Design Scoping review using the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-analysis Extension for Scoping Reviews) guidelines.
Methods A literature search was conducted in MEDLINE and Embase (via Ovid) for articles published between 1 January 2003 and 1 August 2024. Additional grey literature was sourced from institutional repositories, conference proceedings and a manual citation search. Article screening was conducted against a predefined inclusion criteria by two independent, masked reviewers, with a third reviewer acting as arbiter. The inclusion criteria were English language articles which feature a test assessing functional vision in patients with an ophthalmological disease. Details of source characteristics, test methodology and accessibility and evidence of test validation were collected.
Results Of 2665 articles returned by the search, 73 were included and 45 unique tests of functional vision were identified. Diseases affecting the peripheral retina were mainly affected, accounting for 77% (56 out of 73) of the diseases featured in all included studies. Overall, 82% (37 out of 45) functional vision tests reported evidence of statistical validation with varying robustness. Functional vision tests were mapped to domains of orientation and mobility, facial recognition, observer-rated task performance, visual search and driving. Obstacle courses assess vision-guided orientation and mobility, correlate highly with clinical measures of visual function in severe peripheral retinal disease and have been validated for use in clinical trials. Their requirement of physical space and time limits utility in multicentre trials; equivalent tests leveraging virtual reality and eye tracking technologies are in development. Early iterations of visual search tests to simulated realistic scenes have demonstrated discriminative ability, even in paediatric patients.
Conclusions Functional vision tests can facilitate research into future novel ophthalmological treatments that prioritise patients in terms of how clinical benefit is defined. The principal barriers to the uptake of these tests are lack of accessibility, low quality validation and that many tests remain early in their development stage. This review captures the current landscape of functional vision tests and serves as a reference for investigators and regulatory bodies to evaluate the suitability of these tests for ophthalmic clinical trials.
- OPHTHALMOLOGY
- Clinical Trial
- GENETICS
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.
Statistics from Altmetric.com
STRENGTHS AND LIMITATIONS OF THIS STUDY
This review provides the first evaluation of functional vision tests in ophthalmology, focusing on their potential as clinical trial outcome measures.
A comprehensive grey literature search was performed to minimise the risk of bias.
Due to heterogeneity in reported test validation, in-depth statistical analysis of validation data was not undertaken.
Incomplete or insufficiently detailed data in the included studies limited the scope of the analysis.
Introduction
Functional vision tests measure how well individuals can interact with their visual environment,1 and these tests may characterise certain eye diseases better than standard clinical measures of visual function and patient-reported outcome measures (PROMs).2 Functional vision is distinct from visual function which describes the physiological function of the eye and associated visual system, often through contrived clinical tests such as perimetry or visual acuity. Functional vision tests are based on activities of daily living in several domains: mobility, object identification, facial recognition and reading, among others. They output objective scores and can conflate aspects of visual acuity, spatial vision, cognition, colour vision, light sensitivity and adaptation to assess overall function.3 They also consist of relatively complex tasks that assess higher-order visual processing, which may offer a more holistic understanding of visual impairment. In this way, they are highly pertinent measures of a patient’s overall quality of life and have broad potential application as clinically meaningful outcome measures in ophthalmology clinical trials.
Currently accepted visual function outcome measures in ophthalmology include best-corrected visual acuity, perimetry, full-field stimulus testing, microperimetry and mobility testing.4 5 Despite standardisation, visual acuity remains a gross characterisation of overall vision, insensitive to changes in retinal function away from the fovea and displays poor reliability in patients with visual impairment.6 Standard automated perimetry has been the gold standard for detecting optic nerve damage and has been used effectively as an outcome measure in glaucoma trials.7 However, perimetry is limited by low test–retest reliability, particularly in those with poor steady, central fixation in macular disease and certain oculomotor abnormalities, such as nystagmus.6 Fundus-controlled perimetry, or microperimetry, has gained favour in this regard and has become a key endpoint in several clinical trials.8
Structural outcome measures in ophthalmology can offer precise, highly reproducible assessments of disease progression and can delineate anatomical biomarkers. However, these measures may not be applicable if structure and function do not reliably correlate, for instance, where there is amblyopia or a gene defect affecting enzymes of the visual cycle. In these cases, it is unclear how anatomical changes in the eye translate to patient benefit.6
In other medical specialties, functional tests have already been established as key clinical trial endpoints, such as in stroke medicine and multiple sclerosis.9 10 The US Food and Drug Administration has published specific guidelines on patient-centred drug development11 to prioritise the impact of novel treatments on patients. Similarly, the WHO’s International Classification of Functioning, Disability and Health framework classifies health in terms of functioning and disability in daily life.12 It provides the basis for a more integrated understanding of health, with emphasis on practical function rather than solely biomedical variables. Research is ongoing in ophthalmology clinical trials to align with this framework.
Here, a review was undertaken to identify currently available functional vision tests and evaluate their application as clinical trial outcome measures in ophthalmology.
Methods
Search strategy
A scoping review was selected due to the heterogeneity of articles found in the preliminary literature search, and to allow for more exploratory analysis of functional vision tests as an outcome measure. The review was undertaken in accordance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews).13 A literature search was conducted in MEDLINE and Embase (both via Ovid). Publication dates were restricted from 1 January 2003 to 1 August 2024. A grey literature search was conducted to minimise publication bias and maximise the scope of the review. Grey literature sources included a manual citation search, Google Scholar, conference proceedings and the British Library Electronic Theses Online Service. The full Boolean search string with combined index and free text terms is detailed in online supplemental table S1.
Supplemental material
Duplicates were manually removed by two reviewers. Title and abstract screening, and full text screening were conducted against a predefined inclusion criteria by two independent, masked reviewers, with a third reviewer acting as arbiter to resolve disagreement by casting a deciding vote.
Inclusion and exclusion criteria
The inclusion criteria were as follows: (1) Written in the English language; (2) Is a primary research article; (3) Is not a retracted article; (4) Features a test designed for human patients; (5) Test assesses functional vision. Included tests were restricted to those used in patients with an ophthalmological disease. Psychophysical, visual function tests and PROMs were excluded. Although an important domain of functional vision, reading tests were excluded in this search as they have been subject to extensive literature review.14
Data extraction and analysis
Key features of the included texts were charted by two independent, masked reviewers with results synthesised by one reviewer. Data on study design, patient characteristics, test methodology, visual function correlates, validity and repeatability evidence and accessibility were extracted. Specifically, articles were searched for evidence of the following: test responsiveness, inter-rater and intrarater reliability, test–retest reliability, content, construct and criterion validity. Repeatability and validity data were abstracted to only include statistical values of significance and correlation; purely qualitative statements were excluded. Data visualisation was performed with Microsoft Excel 2024 (Microsoft Corporation, USA) and Inkscape (V.0.92).
Patient and public involvement
There was no direct patient or public involvement in this review.
Results
The initial search yielded 2665 articles. After screening, a total of 73 texts were included: 67 peer-reviewed publications and 6 conference abstracts. The full search and screening process is shown in figure 1. Source characteristics of all included studies are summarised in table 1. 45 unique functional vision tests were identified and listed in online supplemental table S2. An abridged list of functional vision tests is listed in table 2. All functional vision tests were grouped into thematic categories for further analysis and are illustrated in figure 2 along a continuum based on their reported ability to measure central or peripheral vision loss. The number of included articles contributing to each category of functional vision test is also shown in figure 2. Orientation and mobility and observer-rated performance tasks accounted for the highest number of articles found with 25 and 22, respectively. Virtual reality (VR) was the least represented with four articles, although all were published within the last 5 years which predicts an expanding area of research, in line with the growth of new technologies. Figure 3 illustrates the disease of the patient population in the included articles categorised by structure of the eye affected, clinical phenotype and genotype. Functional vision tests were mainly investigated in diseases affecting the peripheral retina, which accounted for 77% (56 out of 73) of the diseases featured in all included studies. Rod-cone dystrophies and optic nerve diseases were common, appearing in 37 and 19 articles, respectively. Cone-rod dystrophies and macular disease (both inherited and acquired) featured in fewer studies; 6 and 9, respectively. The number of patients within studies ranged from 4 to 192 and the distribution of reported patient age across all studies is displayed in figure 4. Only 14 out of 73 articles included a paediatric cohort of patient.
Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) flow diagram of the study selection process.
Number of included articles (n=73) contributing to each category of functional vision test. Six categories of functional vision test ordered on a continuum based on reported ability to measure central or peripheral vision loss. Exemplar fundus autofluorescence images depicting severe peripheral retinal degeneration due to RPE65-associated Leber’s congenital amaurosis (left) and discrete central atrophy within the macula due to RPGR-associated cone dystrophy (right). In some severe retinal degenerations, such as end-stage Leber’s congenital amaurosis, extensive peripheral degeneration encroaches centrally, leading to complete loss of light perception.
Disease of patient population in included articles (n=73) categorised by the structure of the eye affected, clinical phenotype and, where reported, genotype. AMD, age-related macular degeneration; RP, retinitis pigmentosa.
Reported age of the patient population assessed with functional vision tests. The dashed line demarcates age 18, below which signifies paediatric testing. Five articles were omitted as no age data was available. Note that there are few studies testing paediatric patient populations and even fewer suitable for preschool age children.
Summary source characteristics of all included studies
Patient population, reference standard, test outcomes and repeatability and validity data of all included studies featuring a functional vision test
A clinical reference standard was identified in 29 out of the 45 functional vision tests. Overall, 37 out of 45 functional vision tests reported evidence of statistical validation, but these were of varying robustness. To date, 7 functional vision tests have been used as outcome measures in 10 separate clinical trials for retinal disease as outlined in table 3.
Functional vision tests used as clinical trial outcome measures
Orientation and mobility tests
The most common format of functional vision test was obstacle course, assessing orientation and mobility. Performance on obstacle courses was generally assessed by speed and accuracy, which were often combined to produce an overall score. Metrics of speed include preferred walking speed, percentage of preferred walking speed and course completion time. Accuracy metrics include error number, number of collisions or incidents or path departure. One study provided more detailed metrics on trajectory analyses and walking initiation time aided by measurement tools such as motion capture systems and inertial sensors.15 Some tests involved videotaped performances which were sent to reading centres for grading to reduce the risk of grader bias.16
Courses ranged in size from 2.1×3.6 m to 68×1.3 m and were located in purpose-built facilities, hospitals and real indoor rooms (eg, a cafeteria). All tests identified in this review were performed indoors, although outdoor mobility tests have been described in the literature.17 18 Some tests were performed under multiple luminance levels, ranging from 0.2 to 500 lux, tested in stages to be sensitive to different levels of nyctalopia. No orientation and mobility test exposed patients to acute changes in illumination to test rapid light or dark adaptation, a common difficulty reported in retinitis pigmentosa, perhaps due to safety concerns. Better designed obstacle courses incorporated changes in floor elevation to assess depth perception. If featured in the course, obstacles were commonly made of cardboard or foam and were suspended at various heights. Some tests reported the Weber contrast values and chromaticity coordinates of the obstacles.
Orientation and mobility tests were predominately used on patients with rod-cone dystrophy or glaucoma. As such, the test is suitable for patients with low vision and defects of peripheral vision. The Multi Luminance Mobility Test (MLMT) was used as a primary outcome measure in the landmark clinical trial of voretigene neparvovec (Luxturna) for RPE65-related Leber’s congenital amaurosis, the first approved gene therapy in ophthalmology.19 The MLMT adopts a binary instead of a continuous scoring system, is performed under seven different luminance levels and demonstrates ceiling effects.20 The low luminance conditions allowed the test to demonstrate sensitivity to changes in disease state; RPE65 is an enzyme which facilitates dark adaptation of viable rod photoreceptors. It follows that a drug capable of rescuing the function of defective RPE65 would result in enhanced scotopic vision.19 The success of the MLMT has subsequently inspired the development of several commercial, academic and dedicated facilities offering functional vision testing, to include Streetlab and Ora.15 21–24 It should, however, be noted that MLMT is primarily an assessment of scotopic vision augmented by dark adaptation of rods and not necessarily the best method to assess cone function.
Applications of virtual reality technology
VR can overcome many limitations of orientation and mobility tests. VR may absolve the need for a physical, homogeneously lit room while still maintaining a degree of realism.25 As such, it is more accessible for use in multicentre clinical trials and can overcome the scaling challenges of physical obstacle courses. However, VR-related motion sickness has been reported, and as a result, patients may still be instructed to walk in physical space to avoid this.26 Commonly used VR headsets include the HTC Vive Pro Eye, Fove 0 and Oculus Rift, which are consumer devices commercially available at a relatively low cost. Proprietary, custom-made software was used on this hardware. Some studies included trackers mounted to patients’ head, hands and feet to generate kinematic data.27 28 The technical specifications of VR devices were as follows: display screens were LED (Light Emitting Diode) or AMOLED (Active-Matrix Organic Light Emitting Diode), panel sizes ranged from 18.5″ to 80″, resolution ranged from 1280 × 1440 to 4K and the horizontal field of view ranged from 89 to 150 degrees. If reported, the display refresh rate was 90 Hz. VR tests were conducted binocularly, although recent iterations enable monocular testing.28 29
Visual search tests
Visual search tasks relate to several domains of functional vision including social interaction, reading, driving and mobility, and have been used to assess patients with various forms of visual impairment.30 31 Visual search may be performed binocularly in front of a display monitor with free head movements or using VR headsets with in-built eye-tracking. Display screen sizes generally range from 17″ to 27″, although a hemispheric, panoramic screen covering 180 degrees of horizontal visual field has been reported.32 Eye tracking devices included the Tobii EyeX, Tobii 4C, Tobii Pro X3-120, Tobii AB (Tobii technology, Stockholm, Sweden), HTC Vive trackers (HTC, New Taipei, Taiwan), Oculus Quest Pro (Meta, Burlingame, California, USA) and the Eyelink II system, Eyelink 1000 system (SR Research, Ontario, Canada). Proprietary, custom-made software was used on this hardware. Task performance metrics were search time and correct responses.
Visual scenes included geometric shapes hidden in a computer-generated room and everyday objects hidden in photographs of real-world scenes. Psychophysical targets such as optotypes or geometric shapes are not intuitively reflective of real life, and studies have shown that a Landolt C search task, compared with object identification in a real photograph, did not differentiate patients from visually healthy controls.33 All scenes found in visual search tasks were two-dimensional and static, and therefore not reflective of dynamic scenes of the real world. The realism and context provided by real world scenes is important as the role of global features and semantic guidance in object search has been well evidenced to influence visual behaviour.34 35 Early iterations of visual search tests in simulated realistic scenes have demonstrated discriminative ability, even in paediatric patients.36 37 One portable tablet-based visual search test was able to discriminate patients with severe diabetic macular oedema from an established normative database.38
Driving simulator tests
Driving simulator tests have previously been used to evaluate safety, for example, in glaucoma and in the development of new multifocal intraocular lenses, but not treatment effectiveness in clinical trials.39 40 Driving simulator tests have been described in many forms. Moving base driving simulators exist that benefit from a realistic car body and wide-field scene projection but lack the accessibility of other portable simulators.41 Desktop-based driving simulators are low fidelity tests, and the lack of real-world consequences from patient error has been reported to influence behaviour by overstating true driving performance.39 The artificial driving scenes in these desktop-based simulators can also cause the patient to subtend a smaller visual angle compared with real life, which inadvertently affects the amplitude of saccadic eye movements—a common measure of performance in driving simulator tests.
Observer-rated visual performance tests
Observer-rated visual performance tests are simulated activities of daily living performed in a controlled environment and assessed by an observer. These tests have been shown to correlate with similar tasks performed at home.42 Tested activities include dialling a phone number, reading in reduced illumination or opening a lock with a key. The original Assessment of Function Related to Vision was limited by ceiling effects and was superseded by the Assessment of Disability Related to Vision. The Compressed Assessment of Ability Related to Vision is a compressed version of this test requiring only 14 min to complete. In 2014, the Functional Low-Vision Observer Rated Assessment was developed as an untimed, home-based test for ultra-low vision patients in the context of a clinical trial for the Argus II retinal prosthesis; a validation study is ongoing.43 A validation study for the more recently developed Instrumental Activities of Daily Living Tools in Very-Low Vision underscores the tests’ potential as an outcome measure in vision restoration trials. It was developed using a Delphi consensus procedure, with input from occupational therapists and low-vision experts, maintaining high levels of content validity.44 Novel observer-rated performance tests are in development with good repeatability and monocular testing.45 Limitations of potential observer bias were reported, although newer test iterations have incorporated automated scoring methods using sensors attached to objects to detect object displacement.46 47 The tests were also subject to floor and ceiling effects48 and could place infeasible cognitive and motor demands on patients in line with the activities assessed, limiting their use to a select subset of suitable patients.
Facial recognition tests
The Cambridge Face Memory Test is a validated, computer-based, alternative forced choice task where a target face must be distinguished from two additional unfamiliar faces. The test is freely available online, performed binocularly and has an established normative reference score. The test demonstrates variable discriminative ability when applied to different disease cohorts. In patients with dry age-related macular degeneration (AMD), the test was not found to be sensitive to early or intermediate stages of dry AMD but was able to discriminate individuals with features of late-stage disease such as geographical atrophy.49 Moreover, one study showed no significant correlation between facial discrimination performance and severity of diabetic macular oedema.38 Co-occurring psychiatric illness, neurological damage or neurodevelopmental disorders such as autism affect facial recognition,50 and facial recognition tests are used cautiously in these populations.
Discussion
A functional vision test has been used as a primary outcome measure in a landmark gene therapy clinical trial in ophthalmology. This has set the stage for the development of more unconventional assessments of vision which will be evaluated here.
Existing functional vision tests in ophthalmology
Orientation and mobility tests were originally used in early clinical trials of retinal prosthesis implants in blind or ultra-low vision patients.51–53 They were favoured as these patients often had remnants of useful vision and light perception that were not captured in standard clinical tests of visual function. As such, these functional tests have relevance in end-stage disease than in early-stage disease where structural changes remain sensitive markers of clinical progression.54 They are useful in measuring low luminance mobility and peripheral vision loss, although individuals with localised degeneration may employ head and eye movements to project the visual environment onto islands of functioning retina. In a study with patients with choroideremia, no deficit in MLMT performance was observed due to preserved macular function even in the presence of advanced peripheral disease.16
Orientation and mobility tests are constrained by several limitations, and performance scores can be marred by many sources of error. First, the tests are inherently influenced by patients’ confidence and psychological state. For example, a distinguishing feature of orientation and mobility tests is that an error committed results in an immediate physical response, such as colliding with an obstacle or wall. How individuals negotiate these physical responses varies widely, in terms of risk management or aversion. Furthermore, if patients are aware of being observed or recorded, then the results may be additionally confounded by the Hawthorne effect. The time taken to complete the course is likely influenced by patient confidence, which may improve if a patient is aware that they have received a potentially sight-saving treatment, thereby conferring a placebo effect. Performance scores may also be confounded by a learning effect, and repeated testing is necessary to overcome this, which can prove laborious for patients—if patients are instructed to repeatedly walk as fast as possible in multiple course runs to determine maximum performance speed, they may be limited by physical stamina rather than their vision.
Practically, the resources required to develop, conduct and maintain these tests limit their scalability and may preclude their continued use in multicentre clinical trials. Several orientation and mobility VR tests have been described that offer easy manipulation of the digital visual environment and potentially unlimited course configurations. These tests provide greater optionality in assessing a range of diseases and control of experimental conditions, therefore improving test reproducibility. The automated scoring performance in VR can also reduce assessor bias. Moreover, VR can make an orientation and mobility test into a game by introducing interactive scoring. For example, tests exist that instruct patients to ‘tag’ obstacles with a controller.28 However, certain limitations arise from the use of VR. The physical VR headset detaches the user from reality and introduces a degree of abstraction to a task. Discrepancies in resolution between the retina and a VR display screen can affect true perception, particularly if the pixel density and resolution are considerably below human acuity.55 VR tests remain in their infancy and require validation in relevant patient populations to ascertain their usability as outcome measures.
VR has also been applied to visual search tests which have demonstrated discriminative ability, even in paediatric patients.36 37 The increased accessibility of eye tracking technology as consumer devices, evidenced by the 2024 release of the Apple Vision Pro, assures further development of VR and visual search tests. An avenue of future development may be wearable technologies that can monitor real-time visual search in daily life over extended periods of time. A similar application is the European Medicines Agency (EMA) approved endpoint of wearable sensors that quantify movement in muscular dystrophy trials.56
Driving simulator tests have been described in several formats, although if patients have been banned from driving due to deteriorating vision, then the psychological impact of being subjected to a driving test should be considered. Not all patients, particularly those with early onset inherited retinal diseases, ever learn to drive, limiting the accessibility of the test.
Inherited retinal diseases: a use case for functional vision tests
Well-designed tests of functional vision relate closely to the prevailing symptoms throughout the natural history of an ophthalmological disease. The symptoms of the disease guide test development to ensure that highly relevant concepts of interest are assessed, and that outcomes remain patient-relevant and pertinent to quality of life. Development and validation are challenging in diseases with variable phenotypes or low prevalence, both exhibited within inherited retinal diseases which collectively represent the leading cause of blindness among working age adults in England and Wales.57 Pathogenic mutations in over 280 genes have been identified as causing inherited retinal disease; each mutation is associated with its own phenotypic characteristics and so patient symptoms can be highly nuanced.58 Selected outcome measures will depend on the underlying disease mechanism and whether a gene-specific or gene-agnostic therapy is developed. The growth of research and development into therapies for these inherited retinal diseases calls for agile innovation in clinical trial outcomes measures to facilitate the arrival of novel gene therapies to market.
Tests that are selected as clinical trial outcome measures should also relate to the region of therapy delivery. For example, in rod-dominated photoreceptor degeneration, the main symptom may be reduced peripheral vision, but if a drug is administered to rescue remaining photoreceptors at the macula, it is logical to preclude the use of a mobility test that may be insensitive to ultimately measure therapy efficacy. This emphasises the importance of judiciously selecting appropriate and effective outcome measures. Additionally, functional vision tests that are performed binocularly have limited utility in clinical trials featuring monocular interventions, particularly where therapy is delivered to the worse seeing eye—as is common practice—as the better seeing eye tends to predict visual functional ability.59 Ideally, both monocular and binocular assessments should be performed. Assessments of binocular function can provide understanding of overall function, leading to interpretations of quality of life and subsequent health economic analyses.
Several inherited retinal diseases are syndromic with systemic abnormalities that may additionally impair a patient’s ability to perform a functional vision test, for reasons other than reduced vision due to retinal degeneration. An example of this is in Joubert’s syndrome, whereby mutations in CEP290 concurrently cause Leber’s congenital amaurosis and psychomotor delay with cerebellar malformations, among other ciliopathy-associated abnormalities.60 Performing a functional vision test in these patients with cognitive and physical impairment would be unreliable in measuring changes in retinal function, and it may be difficult to isolate the true measurement of retinal disease due to the confounding effect of systemic abnormalities.
Challenges in the paediatric validation of functional vision tests
There is a dearth of validated functional vision tests for use in paediatric patients. This is of particular relevance if novel therapies, which are proven to be efficacious in adults, are offered to patients at an earlier age, and in the case of diseases which typically have an early onset of presentation. Examples include Luxturna for RPE65-LCA, which used the MLMT in a trial involving adult patients, but for which treatment may be initiated in younger patients as index presentations are frequently early in life. Tests should be optimised for use in children with appropriate modifications to enable clinical trials and post-trial monitoring to capture the benefit conferred by new treatments. Few functional vision tests identified in this review have been used in children.15 23 27 28 36 37 61–68
Validation of novel functional vision tests
Treatments such as visual prostheses, stem cell transplantation, gene augmentation and editing therapies, antisense oligonucleotide therapy and optogenetic therapies are being developed at pace for previously untreatable ocular conditions.69 Progress in the development of these treatments requires validated outcomes. The paucity of validation in functional vision tests is evidenced in table 2 and S2online supplemental table S2. Few articles reported a full description of test methodology to allow replication, and validation evidence was either absent or fragmented. The absence of an established gold standard test for the measurement of functional vision meant no studies were found to report concurrent validity. Clinically adjudicated reference standards to validate novel tests have been reported in other fields of medicine such as infectious disease diagnostics, and may be useful in the absence of an existing gold standard test.70
The functional vision tests in this review correlate with clinical measures of visual function to varying degrees of significance and construct validity. The appropriateness of this correlation may be questioned, as functional vision tests measure a distinct aspect of vision rather than acting as surrogate indicators of visual function, raising the issue of whether full validation is required in all cases of test development. It can be said that drawing on the experience of clinicians and patients’ perspectives should provide more weight in determining whether test measurements provide useful and clinically meaningful information.
Most current clinical trials adopt a monocular study design to benefit from the contralateral eye as a control, but the need for standardised, precise and reliable outcome measures will become critical once treatments are delivered bilaterally.71 Standardised validation of functional vision tests can improve evidence synthesis, the inferential quality of results and enhance comparability of data between clinical trials with treatments for the same disease. It is reasonable to suggest that functional vision tests should still be validated against standard clinical measures of visual function, but the strength of its validation, or lack thereof, should not solely dictate inclusion as an outcome measure in clinical trials.
In the 1990s, the increase in visual prosthesis development for vision restoration trials led to a greater need for clinically meaningful endpoints. The various centres that developed visual prostheses used different efficacy measurements, making cross-comparison challenging. This led to the International Harmonization of Outcomes and Vision Endpoints in Vision Restoration Trials taskforce, where experts from around the world collaboratively formed guidance to measure visual function in vision restoration clinical trials.72 Most functional vision tests found in this review have been applied to inherited retinal diseases, as shown in table 3, yet there is currently no such directive for inherited retinal disease. Novel clinical trial outcome measures would benefit from being guided by consensus-building to retain standardisation. Stakeholders involved in such consensus-building should include patients, advocacy groups, clinical trial sponsors, disease experts, regulatory agencies and experts in the functional vision construct being measured.
Limitations
The limitations of this review and directions of future research should be considered. A scoping review was selected because of the heterogeneity of the articles identified in the literature search, and it can serve as a foundation for a systematic review or meta-analysis. Test validation in the included studies was reported with varying levels of detail, and as such, in-depth statistical analysis of validation data was not undertaken. Incomplete or insufficiently reported descriptions of tests and data limited the scope of the analysis in some cases. This review aimed to address these limitations by critically evaluating their implications and providing evidence-based recommendations to guide future reporting practices.
Functional vision tests are in development globally, and the regional cultural differences in activities of daily living were not explored in this review, nor were the sources of funding for centres developing functional vision tests. Furthermore, given that functional vision tests assess aspects of higher-order visual processing,3 exploring correlations of functional vision performance scores with primary visual cortex activity may also be an avenue for future research.37
Conclusion
Functional vision tests can facilitate research into future novel ophthalmological treatments that prioritise patients in terms of how clinical benefit is defined. The principal barriers to the uptake of these tests are lack of accessibility, low quality validation and that many tests remain early in their development stage. This review captures the current landscape of functional vision tests and serves as a reference for investigators and regulatory bodies to evaluate the suitability of these tests for ophthalmic clinical trials.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information.
Ethics statements
Patient consent for publication
Ethics approval
Not applicable.
References
Footnotes
Contributors SR was responsible for the design of the scoping review, conducting the search, screening eligible sources, extracting and analysing data, and the writing and preparation of the manuscript. AT contributed to conducting the search, screening eligible sources, extracting and analysing data, and the writing and preparation of the manuscript. LJT contributed to screening eligible sources and writing and preparation of the manuscript. REM contributed to writing and preparation of the manuscript. REM is the guarantor of the manuscript. All authors approved the final version of the manuscript.
Funding This work was supported by the NIHR Oxford Biomedical Research Centre.
Competing interests None declared.
Patient and public involvement Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.