No retraction, correction or concern found when last checked on Oct 30, 2026.
Learning health systems using data to drive healthcare improvement and impact: a systematic review
Joanne Enticott, Alison Johnson, Helena Teede
BMC Health Services Research · 2021 · Systematic review · CC BY
doi:10.1186/s12913-021-06215-8
Abstract
Background. The transition to electronic health records offers the potential for big data to drive the next frontier in healthcare improvement. Yet there are multiple barriers to harnessing the power of data. The Learning Health System (LHS) has emerged as a model to overcome these barriers, yet there remains limited evidence of impact on delivery or outcomes of healthcare.
Objective. To gather evidence on the effects of LHS data hubs or aligned models that use data to deliver healthcare improvement and impact. Any reported impact on the process, delivery or outcomes of healthcare was captured.
Methods. Systematic review from CINAHL, EMBASE, MEDLINE, Medline in-process and Web of Science PubMed databases, using learning health system, data hub, data-driven, ehealth, informatics, collaborations, partnerships, and translation terms. English-language, peer-reviewed literature published between January 2014 and Sept 2019 was captured, supplemented by a grey literature search. Eligibility criteria included studies of LHS data hubs that reported research translation leading to health impact.
Results. Overall, 1076 titles were identified, with 43 eligible studies, across 23 LHS environments. Most LHS environments were in the United States (n = 18) with others in Canada, UK, Sweden and Australia/NZ. Five (21.7%) produced medium-high level of evidence, which were peer-reviewed publications.
Conclusions. LHS environments are producing impact across multiple continents and settings.
Supplementary Information. The online version contains supplementary material available at 10.1186/s12913-021-06215-8.
References 68
- 1.
Medicine., I.o. Roundtable on Value and Science-Driven Health Care: The Learning Health System and its Innovation Collaboratives: Update Report. 2011.
Not in our library
- 2.
Medicine., I.o. Making a Difference: Roundtable Charter, Strategy, Tactics, Impact. 2014.
Not in our library
- 3.
Budrionis A, Bellika JG. The learning healthcare system: where are we now? A systematic review. J Biomed Inform. 2016;64:87-92.
Not in our library10.1016/j.jbi.2016.09.018
- 4.
McLachlan S, et al. The Heimdall framework for supporting characterisation of learning health systems. J Innov Health Inform. 2018;25(2):77-87.
Not in our library10.14236/jhi.v25i2.996
- 5.
- 6.
Scobie S, Castle-Clarke S. Implementing learning health systems in the UK NHS: policy actions to improve collaboration and transparency and support innovation and better use of analytics. Learn Health Syst. 2020;4(1):e10209.
Not in our library10.1002/lrh2.10209
- 7.
Teede H, et al. Australian Health Research Alliance: national priorities in data driven healthcare improvement. Med J Aust. 2019;211(11):494-497.
Not in our library10.5694/mja2.50409
- 8.
Agency for Healthcare Research and Quality (AHRQ), AHRQ Pub No. 19–0052-2. 2019.
Not in our library
- 9.
Friedman C, et al. Toward a science of learning systems: a research agenda for the high-functioning learning health system. J Am Med Inform Assoc. 2015;22(1):43-50.
Not in our library10.1136/amiajnl-2014-002977
- 10.
Flynn A. Informatics and technology enable us to learn from every patient: Pharmacists' many roles in learning health systems. Am J Health Syst Pharm. 2019;76(15):1095-1096.
Not in our library10.1093/ajhp/zxz118
- 11.
Coury J, et al. Applying the plan-do-study-act (PDSA) approach to a large pragmatic study involving safety net clinics. BMC Health Serv Res. 2017;17(1):411.
Not in our library10.1186/s12913-017-2364-3
- 12.
Harvard Business Review Analytic Services. Leading a new era in health care. 2019.
Not in our library
- 13.
Foley JF, Vale L. What role for learning health systems in quality improvementwithin healthcare providers? Learn Health Syst. 2017;1(4):e10025.
Not in our library10.1002/lrh2.10025
- 14.
- 15.
World Bank Group. World Bank Country and Lending Groups Country Classification. 2020.
Not in our library
- 16.
Aoki NJ, Enticott JC, Phillips LE. Searching the literature: four simple steps. Transfusion. 2013;53(1):14-17.
Not in our library10.1111/j.1537-2995.2012.03790.x
- 17.
Enticott J, Braaf S, Johnson A. et al. Leaders’ perspectives on learning health systems: a qualitative study. BMC Health Serv Res. 2020;20:1087. 10.1186/s12913-020-05924-w.
Not in our library10.1186/s12913-020-05924-w
- 18.
Schünemann 2013, Schünemann HBJ, Guyatt G, Oxman A. The GRADE Working Group. GRADE Handbook for Grading Quality of Evidence and Strength of Recommendations. 2013.
Not in our library
- 19.
Smith SK, Rowe K, Abernethy AP. Use of an electronic patient-reported outcome measurement system to improve distress management in oncology. Palliat Support Care. 2014;12(1):69-73.
Not in our library10.1017/s1478951513000345
- 20.
Simianu VV, Kumar AS. Surgical care and outcomes assessment program (SCOAP): a nuanced, flexible platform for colorectal surgical research. Clin Colon Rectal Surg. 2019;32(1):25-32.
Not in our library10.1055/s-0038-1673351
- 21.
Marsolo K, et al. A Digital Architecture for a Network-Based Learning Health System: Integrating Chronic Care Management, Quality Improvement, and Research. eGEMs (Generating Evidence & Methods to improve patient outcomes). 2015;3(1):1168.
Not in our library10.13063/2327-9214.1168
- 22.
McLinden D, et al. The learning exchange, a community knowledge commons for learning networks: qualitative evaluation to test acceptability, feasibility, and utility. JMIR Form Res. 2019;3(1):e9858.
Not in our library10.2196/formative.9858
- 23.
Pitt B, et al. Spironolactone for heart failure with preserved ejection fraction. N Engl J Med. 2014;370(15):1383-1392.
Not in our library10.1056/nejmoa1313731
- 24.
Starren JB, Winter AQ, Lloyd-Jones DM. Enabling a learning health system through a unified Enterprise data warehouse: the experience of the Northwestern University clinical and translational sciences (NUCATS) institute. Clin Transl Sci. 2015;8(4):269-271.
Not in our library10.1111/cts.12294
- 25.
Wagner LI, et al. Bringing PROMIS to practice: brief and precise symptom screening in ambulatory cancer care. Cancer. 2015;121(6):927-934.
Not in our library10.1002/cncr.29104
- 26.
Shah SJ, et al. Phenomapping for novel classification of heart failure with preserved ejection fraction. Circulation. 2015;131(3):269-279.
Not in our library10.1161/circulationaha.114.010637
- 27.
Fung-Kee-Fung M, et al. Piloting a regional collaborative in cancer surgery using a "community of practice" model. Curr Oncol. 2014;21(1):27-34.
Not in our library10.3747/co.21.1663
- 28.
Fung-Kee-Fung M, et al. Regional process redesign of lung cancer care: a learning health system pilot project. Curr Oncol. 2018;25(1):59-66.
Not in our library10.3747/co.25.3719
- 29.
Bhandari RP, et al. Pediatric-collaborative health outcomes information registry (Peds-CHOIR): a learning health system to guide pediatric pain research and treatment. Pain. 2016;157(9):2033-2044.
Not in our library10.1097/j.pain.0000000000000609
- 30.
Briscoe MB, Carlisle B, Cerfolio RJ. Data-driven collaboration: how physicians and administration can team up to improve outcomes. Healthc Financ Manage. 2016;70(7):42-49.
Not in our library
- 31.
Tardif H, et al. Establishment of the Australasian electronic persistent pain outcomes collaboration. Pain Med. 2017;18(6):1007-1018.
Not in our library10.1093/pm/pnw201
- 32.
Laws R, et al. The Community Health Applied Research Network (CHARN) Data Warehouse: a Resource for Patient-Centered Outcomes Research and Quality Improvement in Underserved, Safety Net Populations. eGEMs (Generating Evidence & Methods to improve patient outcomes). 2014;2(3):1097.
Not in our library10.13063/2327-9214.1097
- 33.
Vargas N, et al. Qualitative perspective on the learning health system: how the community health applied research network paved the way for research in safety-net settings. Prog Community Health Partnersh. 2018;12(3):329-339.
Not in our library10.1353/cpr.2018.0057
- 34.
Vo MT, et al. Prompting patients with poorly controlled diabetes to identify visit priorities before primary care visits: a pragmatic cluster randomized trial. J Gen Intern Med. 2019;34(6):831-838.
Not in our library10.1007/s11606-018-4756-4
- 35.
Ransom C, et al. Correspondance: Understanding cognitive barriers to safer prescribing for frail patients. Clinical Pharmacist, CP, May 2018, Vol 10, No 5;10(5):10.1211/PJ.2018.20204794
Not in our library
- 36.
Wade SL, et al. Long-term behavioral outcomes after a randomized, clinical trial of counselor-assisted problem solving for adolescents with complicated mild-to-severe traumatic brain injury. J Neurotrauma. 2015;32(13):967-975.
Not in our library10.1089/neu.2014.3684
- 37.
Lowenstein LM, et al. Randomized trial of a patient-centered decision aid for promoting informed decisions about lung cancer screening: implementation of a PCORI study protocol and lessons learned. Contemp Clin Trials. 2018;72:26-34.
Not in our library10.1016/j.cct.2018.07.007
- 38.
Arterburn D, et al. Comparative effectiveness and safety of bariatric procedures for weight loss: a PCORnet cohort study. Ann Intern Med. 2018;169(11):741-750.
Not in our library10.7326/m17-2786
- 39.
Toh S, et al. The National Patient-Centered Clinical Research Network (PCORnet) bariatric study cohort: rationale, methods, and baseline characteristics. JMIR Res Protoc. 2017;6(12):e222.
Not in our library10.2196/resprot.8323
- 40.
Eriksson JK, Askling J, Arkema EV. The Swedish Rheumatology Quality Register: optimisation of rheumatic disease assessments using register-enriched data. Clin Exp Rheumatol. 2014;32(5 Suppl 85):S-147-9.
Not in our library
- 41.
Neovius M, et al. Drug survival on TNF inhibitors in patients with rheumatoid arthritis comparison of adalimumab, etanercept and infliximab. Ann Rheum Dis. 2015;74(2):354-360.
Not in our library10.1136/annrheumdis-2013-204128
- 42.
Ovretveit J, Nelson E, James B. Building a learning health system using clinical registers: a non-technical introduction. J Health Organ Manag. 2016;30(7):1105-1118.
Not in our library10.1108/jhom-06-2016-0110
- 43.
Cox ED, et al. A Family-Centered Rounds Checklist, Family Engagement, and Patient Safety: A Randomized Trial. Pediatrics. 2017 May;139(5):e20161688. 10.1542/peds.2016-1688.
Not in our library10.1542/peds.2016-1688
- 44.
Bartels CM, et al. Connecting rheumatology patients to primary Care for High Blood Pressure: specialty clinic protocol improves follow-up and population blood pressures. Arthritis Care Res. 2019;71(4):461-470.
Not in our library10.1002/acr.23612
- 45.
Koslov S, et al. Across the divide: "primary care departments working together to redesign care to achieve the triple aim". Healthc (Amst). 2016;4(3):200-206.
Not in our library10.1016/j.hjdsi.2015.12.003
- 46.
Kraft S, et al. Building the learning health system: describing an organizational structure to support continuous learning. Learn Health Syst. 2017;1:e10034.
Not in our library10.1002/lrh2.10034
- 47.
Fife CE. How Should Outpatient Wound Clinics Honestly Measure Success? Todays Wound Clin. 2018;12(4). https://www.todayswoundclinic.com/articles/how-should-outpatient-wound-clinics-honestly-measure-success.
Not in our library
- 48.
Serena TE, et al. A new approach to clinical research: integrating clinical care, quality reporting, and research using a wound care network-based learning healthcare system. Wound Repair Regen. 2017;25(3):354-365.
Not in our library10.1111/wrr.12538
- 49.
- 50.
Noseworthy T, Wasylak T, O'Neill B. Strategic clinical networks in Alberta: structures, processes, and early outcomes. Healthc Manage Forum. 2015;28(6):262-264.
Not in our library10.1177/0840470415600130
- 51.
Psek WA, et al. Operationalizing the learning health care system in an integrated delivery system. eGEMs (Generating Evidence & Methods to improve patient outcomes). 2015;3(1):1122.
Not in our library10.13063/2327-9214.1122
- 52.
Schechter MS, et al. The Cystic Fibrosis Foundation patient registry as a tool for use in quality improvement. BMJ Qual Saf. 2014;23(Suppl 1):i9-14.
Not in our library10.1136/bmjqs-2013-002378
- 53.
Liu VX, et al. Data that drive: closing the loop in the learning hospital system. J Hosp Med. 2016;11(Suppl 1):S11-S17.
Not in our library10.1002/jhm.2651
- 54.
Liu VX, et al. Multicenter implementation of a treatment bundle for patients with Sepsis and intermediate lactate values. Am J Respir Crit Care Med. 2016;193(11):1264-1270.
Not in our library10.1164/rccm.201507-1489oc
- 55.
Pace WD, et al. The DARTNet Institute: Seeking a Sustainable Support Mechanism for Electronic Data Enabled Research Networks. eGEMs (Generating Evidence & Methods to improve patient outcomes). 2014;2(2):1063
Not in our library10.13063/2327-9214.1063
- 56.
Wallace PJ, et al. Optum labs: building a novel node in the learning health care system. Health Aff (Millwood). 2014;33(7):1187-1194.
Not in our library10.1377/hlthaff.2014.0038
- 57.
Lowes LP, et al. 'Learn from every Patient': implementation and early results of a learning health system. Dev Med Child Neurol. 2017;59(2):183-191.
Not in our library10.1111/dmcn.13227
- 58.
Noritz G, et al. "Learn From Every Patient": How a Learning Health System Can Improve Patient Care. Pediatr Qual Saf. 2018;3(5):e100.
Not in our library10.1097/pq9.0000000000000100
- 59.
Moffatt-Bruce S, et al. IDEA4PS: the development of a research-oriented learning healthcare system. Am J Med Qual. 2018;33(4):420-425.
Not in our library10.1177/1062860617751044
- 60.
Rayo MF, et al. Implementing an institution-wide quality improvement policy to ensure appropriate use of continuous cardiac monitoring: a mixed-methods retrospective data analysis and direct observation study. BMJ Qual Saf. 2016;25(10):796-802.
Not in our library10.1136/bmjqs-2015-004137
- 61.
Griffiths and Kapacee. Enabling data flows in Greater Manchester Connected Health City: Connected Health Cities UK; 2019.
Not in our library
- 62.
Wade SL, Kurowski BG. Behavioral clinical trials in moderate to severe pediatric traumatic brain injury: challenges, potential solutions, and lessons learned. J Head Trauma Rehabil. 2017;32(6):433-437.
Not in our library10.1097/htr.0000000000000323
- 63.
Noseworthy T, Wasylak T, O'Neill BJ. Strategic clinical networks: Alberta's response to triple aim. Healthc Pap. 2016;15(3):49-54.
Not in our library
- 64.
Hvitfeldt H, et al. Feed forward systems for patient participation and provider support: adoption results from the original US context to Sweden and beyond. Qual Manag Health Care. 2009;18(4):247-256.
Not in our library10.1097/qmh.0b013e3181bee32e
- 65.
Zurynski Y, et al. White paper - Mapping the Learning Health System: A Scoping Review of Current Evidence, vol. 2020. Sydney, Australia: 2020: Australian Institute of Health Innovation, and the NHRMC partnership Centre for health system sustainability.
Not in our library
- 66.
Blog, P. Funding the Next Generation of Learning-Health-System Researchers. 2017 [cited 18th Sep 2019]; Available from: https://www.pcori.org/blog/funding-next-generation-learning-health-system-researchers.
Not in our library
- 67.
Melder A, et al. An overview of healthcare improvement: unpacking the complexity for clinicians and managers in a learning health system. IMJ. 2020;50(10):1174-1184.
Not in our library10.1111/imj.14876
- 68.
Lessard L, et al. Type and use of digital technology in learning health systems: a scoping review protocol. BMJ Open. 2019;9(5):e026204.
Not in our library10.1136/bmjopen-2018-026204
Reads
Read by people on this page
None yet.
Checked or read by AI through naulon
None yet.
A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.
Are you an author?
Is this your paper?
Claim it to add your note and be paid when agents cite it. Free.