
Navigating Real-World Evidence in Ophthalmology
Authors: Robert P. Finger1, Taiji Sakamoto2, James Talks3, Vincent Daien4,5, Tien Wong6,7, Bora Eldem8, Paul Mitchell9, Jean-François Korobelnik10,11
1 - Department of Ophthalmology, University of Bonn, Bonn, Germany
2 - Department of Ophthalmology, Kagoshima University Graduate School of Medical and Dental Sciences, Kagoshima, and J-CREST, Japan
3 - Department of Ophthalmology, Royal Victoria Infirmary, Newcastle upon Tyne, United Kingdom
4 - Department of Ophthalmology, Gui De Chauliac Hospital, Montpellier, France
5 - The Save Sight Institute, Sydney Medical School, The University of Sydney, Sydney, NSW, Australia
6 - Singapore Eye Research Institute, Singapore National Eye Centre, Singapore, Singapore
7 - Duke-NUS Medical School, Singapore, Singapore
8 - Faculty of Medicine, Ophthalmology Department, Hacettepe University, Ankara, Turkey
9 - Centre for Vision Research, Westmead Institute for Medical Research, University of Sydney, NSW, Australia
10 - CHU Bordeaux, Service d'ophtalmologie, Bordeaux France
11 - Univ. Bordeaux, Inserm, Bordeaux Population Health Research Center, team LEHA, UMR 1219, F-33000 Bordeaux, France
Disclosures:
R. P. Finger – Consulting/paid presentations for Bayer, Novartis, Roche/Genentech, Novelion, Opthea, Inositec, Santhera, Alimera and Ellex, Research for Novartis, Zeiss and CentreVue; T. Sakamoto – Alcon, Bayer, Novartis, Santen, Senju and Wakamoto; J. S. Talks – Advisory boards for Bayer; Novartis and Allergan; Research for Bayer, Novartis, Allergan and Roche; Travel sponsorships for Bayer and Novartis; V. Daien – Alcon, Bayer, Horus, Novartis and Thea; T. Y. Wong – Abbott, Allergan, Bayer, Novartis, Pfizer and Roche; B. M. Eldem – Consultant to Bayer, Novartis, Allergan and Investigator to Roche; P. Mitchell – Consultant for Bayer, Novartis, Allergan, Roche, Abbott; J.-F. Korobelnik – Alcon, Allergan, Bayer, Beaver Visitec, Horus, Krys, Kanghong, NanoRetina, Novartis, Roche, Thea and Zeiss
The authors have no commercial interests in relation to the article. Medical writing and editorial support for preparation of the article, under the guidance of the authors, was provided by ApotheCom, which was funded by Bayer Consumer Health.
Randomised controlled trials (RCTs) are the gold standard to address clinical questions on the efficacy and safety of therapies, using strict criteria and specific methods. This stringency means that RCTs may not fully reflect treatment outcomes in routine clinical practice.1,2 Real-world data (RWD) are generated from studies that more closely represent routine clinical practice, and can include longer-term safety, effectiveness and patient-reported outcome measures. When these data are collected and analysed appropriately, the resulting real-world evidence (RWE) complements information from RCTs, providing additional information to support informed clinical decisions and enhance patient care.1-3
In the context of neovascular age-related macular degeneration (nAMD), the approval and widespread application of intravitreal anti-vascular endothelial growth factor (VEGF) agents has offered the potential to improve and stabilise patients’ visual acuity. Clinical experience from routine practice has contributed to an increased understanding of the impact of these agents on patients and their disease, and is reflected in an increasing body of RWE from a number of RWD sources.2,4 These real-world studies have provided valuable insight into long-term outcomes and utilisation of anti-VEGF agents in nAMD, but have also revealed differences in outcomes achieved with anti-VEGF agents in clinical practice, compared with RCTs.5 Identification of these disparities has allowed for variations in treatment practices to be highlighted, resulting in the opportunity to improve services, understand the need for proactive treatment and establish new treatment regimens, such as treat-and-extend.5
As with all forms of data generation, there are inherent limitations to the study designs associated with RWD collection. It is therefore important that the quality of each piece of RWE is carefully assessed, to ensure reliable conclusions can be drawn that are applicable to clinical practice.1,4,6,7
Sources of bias in RWE
Specific biases that can influence RWE quality reflect the generation of data from patients outside the stringently controlled environment of an RCT and are summarised in Figure 1. Appropriate statistical analyses are necessary to control for the presence of biases and confounding factors, to allow robust, clinically relevant conclusions to be made.
Strengths and weaknesses of sources of RWD in retinal disease
- RWD can be collected prospectively, to answer a specific research question (known as primary RWD), or retrospectively (known as secondary RWD), and can include collection from multiple sources. In a prospective study, participants are enrolled and followed in time to observe outcomes; in a retrospective study, investigators use pre-existing data to identify participants in the past and follow them forward to determine outcomes. Although potentially restricted by incomplete historical data records, retrospective studies may be quicker and more cost-effective to set up due to use of previously existing data. The strengths and weaknesses of the main sources of RWD in retinal disease are discussed below.
Non-interventional studies
A non-interventional study is one in which the treatment is prescribed in the usual manner, according to usual day-to-day clinical practice patterns, rather than the assignment of a patient to a treatment being decided in advance by a trial protocol. The prescription of a treatment is therefore clearly separated from the decision to include the patient in the study. These studies can be prospective or retrospective and can follow a range of different designs. Some of the most commonly used non-interventional study designs are described below.
- Cohort studies are the most widely used and well-known study designs used in ophthalmology. These studies identify a group of people and follow them over a period of time to see how their exposures affect their outcomes. Prospective designs allow for standardised patient inclusion criteria and calculation of incidence rates, relative risks and attributable risks within a set time period. PERSEUS10 and RAINBOW11 are examples of prospective cohort studies in patients with nAMD while LUMINOUS12 is an example of a combined prospective and retrospective study design.
- Case-control studies are characterised by the identification of patients with the condition of interest and comparison with matched controls. They can be used to investigate any treatment-associated adverse events and assess rare conditions or outcomes, such as post-surgical endophthalmitis.13 These studies are usually retrospective, which typically makes them cost-effective and quick to establish, but they are susceptible to recall bias and confounding factors associated with missing values attributable to poor record-keeping.5,14
Case studies/series typically report on one or a series of patients with the condition of interest;5 for example, case series from Japan have provided data on the effectiveness of intravitreal aflibercept monotherapy in polypoidal choroidal vasculopathy, a subtype of nAMD.3 They can focus on interesting or key elements of disease history and treatment, such as adverse events, or assess treatments and practices not yet studied in RCTs. However, since patient numbers are often low, there is a risk of selection bias that can lead to overestimation or misinterpretation of outcomes.5
Patient registries
Data from patient registries are typically prospectively collected to evaluate specified outcomes for a predefined population. Patients are included in registries via an exposure (drug/medical device/environmental exposure) or via having a certain pre-specified disease. These registries serve predetermined scientific, clinical or policy purposes and can be used to collect post-marketing safety data, understand the natural history of a condition, or assess various qualities of care experienced by patients.7 The Fight Retinal Blindness! (FRB!) project is a registry that tracks RWD on nAMD, choroidal neovascularisation, diabetic macular oedema and retinal vein occlusion from public and private health settings in Australia, New Zealand, Singapore and European countries, including Switzerland, the Netherlands, the UK, Spain, France and Austria. The database is unique in holding 10 years of international data on treatment outcomes for nAMD.5,15,16
Electronic health records
Electronic health records can provide a comprehensive record of an individual’s health and clinical history, including demographic data, medical history, diagnostic and laboratory test results, treatments and procedures. Medisoft Ophthalmology and mediSIGHT are UK electronic health record systems17 that hold information on clinical visits, assessments, ophthalmic procedures and clinical outcomes, and aim to make electronic health record data available for quality control/research purposes. Electronic health records can be used relatively simply to retrospectively compare outcomes between patients treated using different approaches (e.g. different anti-VEGF agents or dosing regimens), but are dependent on the completeness of record-keeping to provide complete datasets.5
Reimbursement claims databases
Reimbursement claims databases provide data on the types and frequency of diagnostic procedures and medications routinely used in clinical practice. Databases comprising data from both public and private systems exist worldwide, such as the US Medicare database18 and the UK Clinical Practice Research Datalink.19 Claims data are a valuable source of large, diverse patient populations that lack selection bias, and longitudinal follow-up data are often available – because of their large size, insights into rare events can be gained from these databases.3 However, there are inherent limitations of claims data, including incomplete, inaccurate, or missing data, the inability to evaluate the appropriateness of care,20 and their primary purpose not being to collect safety and/or effectiveness data.
Patient surveys and questionnaires
Patient surveys can be conducted in person or remotely (electronically or by phone) and can be used to collect patient-relevant data on aspects such as adherence, preferences, functional status and quality of care. For example, the VISION 2020 UK Eye Survey aims to find out about the eye health of 250,000 people living in the UK.21 While patient surveys and questionnaires are able to collect information on outcomes rarely reported in other studies, limitations include introduction of subjectivity on outcome reporting, the potential for survey wording to influence answers, and recall bias.5
Evaluating sources of RWD in retinal disease
The increasing importance of RWE in clinical decision-making means that it is important for practising ophthalmologists to be able to easily evaluate the quality of published RWE and the applicability of findings to clinical practice. In order to do this, simple tools are required to facilitate critical evaluation of published RWE, considering important factors including the data source, study design and analyses in relation to the research question.5
Some resources are available to aid practising ophthalmologists in their evaluation of the quality of RWE. For example, the International Consortium for Health Outcomes Measurement (ICHOM) has defined a minimum set of standardised and patient-oriented outcome measures that should be collected and reported as RWD on macular degeneration. These include patient baseline status, clinical outcomes, patient treatment and management, patient safety, quality of life, and healthcare economics.22 The Good Research for Comparative Effectiveness (GRACE) principles can also be used to support clinicians, researchers, and decision-makers in evaluating the quality of observational comparative effectiveness studies (Figure 2).23 However, availability of a framework to facilitate the systematic assessment of quality and relevance of RWE concerning intravitreal anti-VEGF therapy, specifically, would be valuable. Inclusion of retinal disease-specific considerations, such as method of administration and injection clinic set-up, would help ophthalmologists to more easily and accurately assess the quality of the RWE relating to the use of anti-VEGFs.
Summary
RWE can provide insights into key outcomes in retinal disease as experienced in every-day practice, including long- and short-term effects on vision, as well as patient-reported outcomes. In this way, findings from RWE can positively influence the treatment of retinal disease in clinical practice, for example by providing insights into optimising treatment adherence and injection frequency, to improve and preserve visual acuity.5 Critical evaluation of the method of RWD collection, the subsequent analysis and reporting, and the conclusions drawn are important to permit effective assessment of the quality of published RWE. This enables judgement of the relevance and applicability of RWE to clinical practice and supports confidence in translation of the findings from RWE into clinical practice, to optimise care for patients with nAMD.
References
- Garrison LP, Jr., Neumann PJ, Erickson P, Marshall D, Mullins CD. Using real-world data for coverage and payment decisions: the ISPOR Real-World Data Task Force report. Value in Health: the journal of the International Society for Pharmacoeconomics and Outcomes Research. 2007;10(5):326-335.
- Mehta H, Tufail A, Daien V, et al. Real-world outcomes in patients with neovascular age-related macular degeneration treated with intravitreal vascular endothelial growth factor inhibitors. Progress in retinal and eye research. 2018;65:127-146.
- Talks J, Daien V, Finger RP, et al. The use of real-world evidence for evaluating anti-vascular endothelial growth factor treatment of neovascular age-related macular degeneration. Surv Ophthalmol. 2019:doi: 10.1016/j.survophthal.2019.1002.1008. [Epub ahead of print].
- Berger M, Daniel G, Frank K, et al. White paper: A framework for regulatory use of real-world evidence. 2017.
- Talks J. Utility of real-world evidence for evaluating anti–vascular endothelial growth factor treatment of neovascular age-related macular degeneration. Survey of Ophthalmology. 2018;In press.
- Parke Ii DW, Lum F, Rich WL. The IRIS(R) Registry : Purpose and perspectives. Der Ophthalmologe : Zeitschrift der Deutschen Ophthalmologischen Gesellschaft. 2017;114(Suppl 1):1-6.
- RWE Navigator. Putting real-world healthcare data to work. Available at:
https://rwe-navigator.eu/use-real-world-evidence/sources-of-real-world-data/healthcare-databases-with-a-focus-on-electronic-health-records/ . - Grimes DA, Schulz KF. Bias and causal associations in observational research. Lancet (London, England). 2002;359(9302):248-252.
- Bethesda (MD): National Center for Biotechnology Information (US); 2005. Ascertainment Bias. Available from:
https://www.ncbi.nlm.nih.gov/books/NBK9792/ . - Framme C, Eter N, Hamacher T, et al. Aflibercept for patients with neovascular age-related macular degeneration in routine clinical practice in Germany: Twelve month outcomes of PERSEUS. Ophthalmology Retina. 2018;2(6):539-549.
- Weber M, Velasque L, Coscas F, Faure C, Aubry I, Cohen ANobotRsi. Effectiveness and safety of intravitreal aflibercept in patients with wet age-related macular degeneration treated in routine clinical practices across France: 12-month outcomes of the RAINBOW study. BMJ Open Ophthalmology. 2019;Accepted.
- Semoun O, Cohen SY, Srour M, et al. [Individualized management of patients with exudative AMD, IOI protocol: Injection-observational-individualization]. J Fr Ophtalmol. 2017;40(3):169-176.
- S L, P C. Epidemiology in Practice: Case-control studies. Community Eye Health. 1998;11(28):57-58.
- Lewallen S, Courtright P. Epidemiology in practice: case-control studies. Community Eye Health. 1998;11(28):57-58.
- Save Sight Registries. Available at:
http://savesightregistries.org/about-us/ . - Save Sight Institute website. Available from:
http://www.savesightinstitute.org.au/ . - Medisoft Ophthalmology. Available from:
http://www.medisoft.co.uk/medisoft-ophthalmology . - Centers for Medicare and Medicaid Services. CMS Program Statistics. Available from:
https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/CMSProgramStatistics/index.html . - Clinical Practice Research Datalink. Available from:
https://www.cprd.com/home/ . - Stein JD, Lum F, Lee PP, Rich WL, 3rd, Coleman AL. Use of health care claims data to study patients with ophthalmologic conditions. Ophthalmology. 2014;121(5):1134-1141.
- VISION 2020 UK. Available from:
https://www.opticianonline.net/news/vision-2020-uk-plans-eye-health-survey-1 . - Rodrigues IA, Sprinkhuizen SM, Barthelmes D, et al. Defining a Minimum Set of Standardized Patient-centered Outcome Measures for Macular Degeneration. Am J Ophthalmol. 2016;168:1-12.
- Dreyer NA, Bryant A, Velentgas P. The GRACE Checklist: A Validated Assessment Tool for High Quality Observational Studies of Comparative Effectiveness. Journal of managed care & specialty pharmacy. 2016;22(10):1107-1113.




















