Vol 10, No 5 (2021)
Other materials agreed with the Editors
Published online: 2021-11-03
A review on generation of real-world evidence
DOI: 10.5603/DK.2021.0049
Clin Diabetol 2021;10(5):412-419.
Abstract
Real-world evidence can generate credible evidence to inform treatment decisions. Real-world evidence is in developmental stage and is fast evolving yet there are many unexplained attributes of real-world evidence. Real-world evidence informs benefit-risk decisions and is increasingly being used to support regulatory decision making. Potential benefits of real-world data include determination of extended outcomes including long-term outcomes, opportunities to partner with patients in innovative ways, and reduction in time and cost to generate dependable evidence. Limitations of real-world evidence include uncertainty in the quality of datasets and lack methodologic rigor in real-world studies. Use of real-world evidence for healthcare practices and policies is limited. Ensuring completeness, homogeneity, and linkage of datasets can enhance utility for epidemiological investigations and improvement in health outcomes. Research should be strengthened for real-world studies and technical standards should be reinforced. Collaborations of stakeholders is key to formulation and adoption of guidance for real-world evidence. Real-world data cannot be a substitute to randomized clinical studies but can possibly augment the generated evidence.
Keywords: Real-world evidenceHealthcare policiesReal-world dataPragmatic trialsPolicy making
References
- Khosla S, White R, Medina J, et al. Real world evidence (RWE) - a disruptive innovation or the quiet evolution of medical evidence generation? F1000Res. 2018; 7: 111.
- Sherman RE, Anderson SA, Dal Pan GJ, et al. Real-World Evidence - What Is It and What Can It Tell Us? N Engl J Med. 2016; 375(23): 2293–2297.
- Makady A, de Boer A, Hillege H, et al. (on behalf of GetReal Work Package 1). What Is Real-World Data? A Review of Definitions Based on Literature and Stakeholder Interviews. Value Health. 2017; 20(7): 858–865.
- USFDA. Framework for FDA’s Real-World Evidence Program. December 2018. https://www.fda.gov/media/120060/download. (11.10.2019).
- Real-World Evidence. U.S. Food and Drug Administration. https://www.fda.gov/science-research/science-and-research-special-topics/real-world- evidence (12.10.2019).
- Mulder R, Singh AB, Hamilton A, et al. The limitations of using randomised controlled trials as a basis for developing treatment guidelines. Evid Based Ment Health. 2018; 21(1): 4–6.
- Cartwright N, Munro E. The limitations of randomized controlled trials in predicting effectiveness. J Eval Clin Pract. 2010; 16(2): 260–266.
- Bhatt A. Conducting real-world evidence studies in India. Perspect Clin Res. 2019; 10(2): 51–56.
- Kim SY. Efficacy versus Effectiveness. Korean J Fam Med. 2013; 34(4): 227.
- Klonoff DC. The New FDA Real-World Evidence Program to Support Development of Drugs and Biologics. J Diabetes Sci Technol. 2020; 14(2): 345–349.
- Dang A, Vallish BN. Real world evidence: An Indian perspective. Perspect Clin Res. 2016; 7(4): 156–160.
- Tibaldi JM, Hansen BB, Wolden ML, et al. Real-World Assessment of Clinical Effectiveness when Switching to Insulin Degludec from Another Basal Insulin among Type 2 Diabetes Patients in the U.S. Diabetes. 2017; 66(Supl. 1): A261.
- Sun X, Tan J, Tang Li, et al. Real world evidence: experience and lessons from China. BMJ. 2018; 360: j5262.
- Kalra S, Gupta Y. Planning a research project: The seven As checklist. J Pak Med Assoc. 2016; 66(12): 1515–1516.
- Harashima SI, Nishimura A, Inagaki N. Attitudes of patients and physicians to insulin therapy in Japan: an analysis of the Global Attitude of Patients and Physicians in Insulin Therapy study. Expert Opin Pharmacother. 2017; 18(1): 5–11.
- Siegmund T, Tentolouris N, Knudsen ST, et al. EU-TREAT study group. A European, multicentre, retrospective, non-interventional study (EU-TREAT) of the effectiveness of insulin degludec after switching basal insulin in a population with type 1 or type 2 diabetes. Diabetes Obes Metab. 2018; 20(3): 689–697.
- Price H, Blüher M, Prager R, et al. EXTRA study group. Use and effectiveness of a fixed-ratio combination of insulin degludec/liraglutide (IDegLira) in a real-world population with type 2 diabetes: Results from a European, multicentre, retrospective chart review study. Diabetes Obes Metab. 2018; 20(4): 954–962.
- Melzer Cohen C, Thorsted BL, Wolden ML, et al. Improved Glycemic Control Achieved by Switching to Insulin Degludec in Insulin-Treated Patients with Type 2 Diabetes in a Real-World Setting: a Non-interventional, Retrospective Cohort Study. Diabetes Ther. 2017; 8(5): 1047–1055.
- Fadini GP, Giordano C, Salvi L, et al. REFLECT Italian Study Group. Reduced Rates of Hypoglycemia in Type 1 or Type 2 Diabetes After Switching to Insulin Degludec: Results from the Italian Cohort of the ReFLeCT Study. Diabetes Ther. 2020; 11(12): 2909–2920.
- Gautier JF, Martinez L, Penfornis A, et al. Effectiveness and Persistence with Liraglutide Among Patients with Type 2 Diabetes in Routine Clinical Practice--EVIDENCE: A Prospective, 2-Year Follow-Up, Observational, Post-Marketing Study. Adv Ther. 2015; 32(9): 838–853.
- Sesti G, Bardtrum L, Dagdelen S, et al. A greater proportion of participants with type 2 diabetes achieve treatment targets with insulin degludec/liraglutide versus insulin glargine 100 units/mL at 26 weeks: DUAL VIII, a randomized trial designed to resemble clinical practice. Diabetes Obes Metab. 2020; 22(5): 873–878.
- Pacurariu A, Plueschke K, McGettigan P, et al. Electronic healthcare databases in Europe: descriptive analysis of characteristics and potential for use in medicines regulation. BMJ Open. 2018; 8(9): e023090.
- Asche CV, Zografos P, Norlin JM, et al. Evaluation of Resource Utilization and Treatment Patterns in Patients with Actinic Keratosis in the United States. Value Health. 2016; 19(2): 239–248.
- Khunti K, Wolden ML, Thorsted BL, et al. Clinical inertia in people with type 2 diabetes: a retrospective cohort study of more than 80,000 people. Diabetes Care. 2013; 36(11): 3411–3417.
- Gliklich RE, Dreyer NA, Leavy MB, editors. Registries for Evaluating Patient Outcomes: A User's Guide [Internet]. 3rd edition. Rockville (MD): Agency for Healthcare Research and Quality (US); 2014 Apr. Report No.: 13 (14)-EHC111.
- Lacasse Y, Krishnan JA, Maltais F, et al. Patient registries for home oxygen research and evaluation. Int J Chron Obstruct Pulmon Dis. 2019; 14: 1299–1304.
- Ziemssen T, Rothenbacher D, Kuhle J, et al. [Real-world evidence : Benefits and limitations in multiple sclerosis research]. Nervenarzt. 2017; 88(10): 1153–1158.
- Ma H, Russek-Cohen E, Izem R, et al. Sources of Safety Data and Statistical Strategies for Design and Analysis: Transforming Data Into Evidence. Ther Innov Regul Sci. 2018; 52(2): 187–198.
- Fawzy AM, Yang WY, Lip GYh. Safety of direct oral anticoagulants in real-world clinical practice: translating the trials to everyday clinical management. Expert Opin Drug Saf. 2019; 18(3): 187–209.
- Brod M, Wolden M, Christensen T, et al. A nine country study of the burden of non-severe nocturnal hypoglycaemic events on diabetes management and daily function. Diabetes Obes Metab. 2013; 15(6): 546–557.
- Irving E, van den Bor R, Welsing P, et al. GetReal Work Package 3. Series: Pragmatic trials and real world evidence: Paper 7. Safety, quality and monitoring. J Clin Epidemiol. 2017; 91: 6–12.
- Ford I, Norrie J. Pragmatic Trials. N Engl J Med. 2016; 375(5): 454–463.
- Alphs L, Benson C, Cheshire-Kinney K, et al. Real-world outcomes of paliperidone palmitate compared to daily oral antipsychotic therapy in schizophrenia: a randomized, open-label, review board-blinded 15-month study. J Clin Psychiatry. 2015; 76(5): 554–561.
- Lin D, Thompson-Leduc P, Ghelerter I, et al. Real-World Evidence of the Clinical and Economic Impact of Long-Acting Injectable Versus Oral Antipsychotics Among Patients with Schizophrenia in the United States: A Systematic Review and Meta-Analysis. CNS Drugs. 2021; 35(5): 469–481.
- Przepiorka D, Ko CW, Deisseroth A, et al. FDA Approval: Blinatumomab. Clin Cancer Res. 2015; 21(18): 4035–4039.
- Real-world data (RWD) and real-world evidence (RWE) are playing an increasing role in health care decisions. https://www.fda.gov/science- research/science-and-research-special-topics/real-world-evidence.
- European Medicines Agency. ICH E9 (R1) addendum on estimands and sensitivity 5 analysis in clinical trials to the guideline on statistical 6 principles for clinical trials. 30 August 2017. EMA/CHMP/ICH/436221/2017. https://www.ema.europa.eu/en/documents/scientific-guideline/draft-ich-e9-r1- addendum-estimands-sensitivity-analysis-clinical-trials-guideline-statistical_en.pdf (11.10.2019).
- PDUFA REAUTHORIZATION PERFORMANCE GOALS AND PROCEDURES FISCAL YEARS 2018 THROUGH 2022. https://www.fda.gov/media/99140/download (23.10.2019).
- Kim HS, Lee S, Kim JuH. Real-world Evidence versus Randomized Controlled Trial: Clinical Research Based on Electronic Medical Records. J Korean Med Sci. 2018; 33(34): e213.
- Jarow JP, LaVange L, Woodcock J. Multidimensional Evidence Generation and FDA Regulatory Decision Making: Defining and Using "Real-World" Data. JAMA. 2017; 318(8): 703–704.
- Rudrapatna VA, Butte AJ. Opportunities and challenges in using real-world data for health care. J Clin Invest. 2020; 130(2): 565–574.
- Gliklich & Dreyer (eds). Registries for evaluating patient outcomes: a user’s guide. 2nd ed. Rockville, MD: AHRQ, 2010. https://www.ncbi.nlm.nih.gov/books/NBK49444/.
- Hampson G, Towse A, Dreitlein WB, et al. Real-world evidence for coverage decisions: opportunities and challenges. J Comp Eff Res. 2018; 7(12): 1133–1143.
- Petracci F, Ghai C, Pangilinan A, et al. Use of real-world evidence for oncology clinical decision making in emerging economies. Future Oncol. 2021 [Epub ahead of print].
- Kwong JSw, Sun X. Development of local clinical practice guidelines in the real world: an evolving scene in China. Heart Asia. 2017; 9(2): e010903.
- Dang A, Vallish BN. Real world evidence: An Indian perspective. Perspect Clin Res. 2016; 7(4): 156–160.
- Kim HS, Kim JuH. Proceed with Caution When Using Real World Data and Real World Evidence. J Korean Med Sci. 2019; 34(4): e28.
- Neubert A, Sturkenboom MC, Murray ML, et al. TEDDY Network of Excellence. Databases for pediatric medicine research in Europe--assessment and critical appraisal. Pharmacoepidemiol Drug Saf. 2008; 17(12): 1155–1167.