Skip to content
naulon
Get started

No retraction, correction or concern found when last checked on Oct 15, 2026.

Scalable and accurate deep learning with electronic health records

Alvin Rajkomar, Eyal Oren, Kai Chen and 32 more

npj Digital Medicine · 2018 · arXiv licence (no reuse)

doi:10.1038/s41746-018-0029-1

Abstract

Predictive modeling with electronic health record (EHR) data is anticipated to drive personalized medicine and improve healthcare quality. Constructing predictive statistical models typically requires extraction of curated predictor variables from normalized EHR data, a labor-intensive process that discards the vast majority of information in each patient’s record. We propose a representation of patients’ entire raw EHR records based on the Fast Healthcare Interoperability Resources (FHIR) format. We demonstrate that deep learning methods using this representation are capable of accurately predicting multiple medical events from multiple centers without site-specific data harmonization. We validated our approach using de-identified EHR data from two US academic medical centers with 216,221 adult patients hospitalized for at least 24 h. In the sequential format we propose, this volume of EHR data unrolled into a total of 46,864,534,945 data points, including clinical notes. Deep learning models achieved high accuracy for tasks such as predicting: in-hospital mortality (area under the receiver operator curve [AUROC] across sites 0.93–0.94), 30-day unplanned readmission (AUROC 0.75–0.76), prolonged length of stay (AUROC 0.85–0.86), and all of a patient’s final discharge diagnoses (frequency-weighted AUROC 0.90). These models outperformed traditional, clinically-used predictive models in all cases. We believe that this approach can be used to create accurate and scalable predictions for a variety of clinical scenarios. In a case study of a particular prediction, we demonstrate that neural networks can be used to identify relevant information from the patient’s chart.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

Read at PubMed Central

References 89

  1. 1.

    The Digital Universe: Driving Data Growth in Healthcare. Available at: https://www.emc.com/analyst-report/digital-universe-healthcare-vertical-report-ar.pdf (Accessed 23 Feb 2017).

    Not in our library

  2. 2.

    Parikh RB, Schwartz JS, Navathe AS. Beyond genes and molecules - a precision delivery initiative for precision medicine. N. Engl. J. Med. 2017;376:1609-1612.

    Not in our library10.1056/nejmp1613224

  3. 3.

    Parikh RB, Kakad M, Bates DW. Integrating predictive analytics into high-value care: the dawn of precision delivery. JAMA. 2016;315:651-652.

    Not in our library10.1001/jama.2015.19417

  4. 4.

    Bates DW, Saria S, Ohno-Machado L, Shah A, Escobar G. Big data in health care: using analytics to identify and manage high-risk and high-cost patients. Health Aff. 2014;33:1123-1131.

    Not in our library10.1377/hlthaff.2014.0041

  5. 5.

    Krumholz HM. Big data and new knowledge in medicine: the thinking, training, and tools needed for a learning health system. Health Aff. 2014;33:1163-1170.

    Not in our library10.1377/hlthaff.2014.0053

  6. 6.

    Jameson JL, Longo DL. Precision medicine--personalized, problematic, and promising. N. Engl. J. Med. 2015;372:2229-2234.

    Not in our library10.1056/nejmsb1503104

  7. 7.

    Goldstein BA, Navar AM, Pencina MJ, Ioannidis JPA. Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J. Am. Med. Inform. Assoc. 2017;24:198-208.

    Not in our library10.1093/jamia/ocw042

  8. 8.

    Press, G. Cleaning big data: most time-consuming, least enjoyable data science task, survey says. Forbes (2016). Available at: https://www.forbes.com/sites/gilpress/2016/03/23/data-preparation-most-time-consuming-least-enjoyable-data-science-task-survey-says/ (Accessed 22 Oct 2017).

    Not in our library

  9. 9.

    Lohr, S. For Big-Data Scientists, ‘Janitor Work’ Is Key Hurdle to Insights. (NY Times, 2014).

    Not in our library

  10. 10.
    Insights into the Problem of Alarm Fatigue with Physiologic Monitor Devices: A Comprehensive Observational Study of Consecutive Intensive Care Unit Patients · 2014
    No notice
  11. 11.

    Chopra V, McMahon LF. Redesigning hospital alarms for patient safety: alarmed and potentially dangerous. JAMA. 2014;311:1199-1200.

    Not in our library10.1001/jama.2014.710

  12. 12.

    Kaukonen KM, Bailey M, Pilcher D, Cooper DJ, Bellomo R. Systemic inflammatory response syndrome criteria in defining severe sepsis. N. Engl. J. Med. 2015;372:1629-1638.

    Not in our library10.1056/nejmoa1415236

  13. 13.
    Deep learning · 2015
    No notice
  14. 14.

    Frome, A. et al. DeViSE: a deep visual-semantic embedding model. In Advances in Neural Information Processing Systems 26 (eds Burges, C. J. C., Bottou, L., Welling, M., Ghahramani, Z. & Weinberger, K. Q.), pp 2121–2129 (Curran Associates, Inc. Red Hook, NY, 2013).

    Not in our library

  15. 15.

    Gulshan V, et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA. 2016;316:2402-2410.

    Not in our library10.1001/jama.2016.17216

  16. 16.

    Wu, Y. et al. Google’s neural machine translation system: bridging the gap between human and machine translation. arXiv [cs.CL] (2016).

    Not in our library

  17. 17.

    Dai, A. M. & Le, Q. V. Semi-supervised sequence learning. In Advances in Neural Information Processing Systems 28 (eds Cortes, C., Lawrence, N. D., Lee, D. D., Sugiyama, M. & Garnett, R.), pp 3079–3087 (Curran Associates, Inc. Red Hook, NY, 2015).

    Not in our library

  18. 18.

    Bengio Y, Courville A, Vincent P. Representation learning: a review and new perspectives. IEEE. Trans. Pattern Anal. Mach. Intell. 2013;35:1798-1828.

    Not in our library10.1109/tpami.2013.50

  19. 19.

    Weed LL. Medical records that guide and teach. N. Engl. J. Med. 1968;278:652-657.

    Not in our library10.1056/nejm196803212781204

  20. 20.

    Adler-Milstein J, et al. Electronic health record adoption In US hospitals: progress continues, but challenges persist. Health Aff. 2015;34:2174-2180.

    Not in our library10.1377/hlthaff.2015.0992

  21. 21.

    Mandell LA, et al. Infectious Diseases Society of America/American Thoracic Society consensus guidelines on the management of community-acquired pneumonia in adults. Clin. Infect. Dis. 2007;44:S27-S72.

    Not in our library10.1086/511159

  22. 22.

    Lim WS, Smith DL, Wise MP, Welham SA. British Thoracic Society community acquired pneumonia guideline and the NICE pneumonia guideline: how they fit together. BMJ Open Respir. Res. 2015;2:e000091.

    Not in our library10.1136/bmjresp-2015-000091

  23. 23.

    Churpek MM, et al. Multicenter comparison of machine learning methods and conventional regression for predicting clinical deterioration on the wards. Crit. Care. Med. 2016;44:368-374.

    Not in our library10.1097/ccm.0000000000001571

  24. 24.

    Howell MD, et al. Sustained effectiveness of a primary-team-based rapid response system. Crit. Care. Med. 2012;40:2562-2568.

    Not in our library10.1097/ccm.0b013e318259007b

  25. 25.

    Sun H, et al. Semantic processing of EHR data for clinical research. J. Biomed. Inform. 2015;58:247-259.

    Not in our library10.1016/j.jbi.2015.10.009

  26. 26.

    Newton KM, et al. Validation of electronic medical record-based phenotyping algorithms: results and lessons learned from the eMERGE network. J. Am. Med. Inform. Assoc. 2013;20:e147-e154.

    Not in our library10.1136/amiajnl-2012-000896

  27. 27.

    OHDSI. OMOP common data model. Observational health data sciences and informatics. Available at: https://www.ohdsi.org/data-standardization/the-common-data-model/ (Accessed 23 Jan 2018).

    Not in our library

  28. 28.

    Mandel JC, Kreda DA, Mandl KD, Kohane IS, Ramoni RB. SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J. Am. Med. Inform. Assoc. 2016;23:899-908.

    Not in our library10.1093/jamia/ocv189

  29. 29.
    Deep Patient: An Unsupervised Representation to Predict the Future of Patients from the Electronic Health Records · 2016
    No notice
  30. 30.

    Lipton, Z. C., Kale, D. C., Elkan, C. & Wetzel, R. Learning to diagnose with LSTM recurrent neural networks. arXiv [cs.LG] (2015).

    Not in our library

  31. 31.

    Aczon, M. et al. Dynamic mortality risk predictions in pediatric critical care using recurrent neural networks. arXiv [stat.ML] (2017).

    Not in our library

  32. 32.

    Choi, E., Bahadori, M. T., Schuetz, A., Stewart, W. F. & Sun, J. Doctor AI: predicting clinical events via recurrent neural networks. In Proceedings of the 1st Machine Learning for Healthcare Conference, vol 56 (eds F. Doshi-Velez, J. Fackler, D. Kale and B. Wallace, J. Wiens) 301–318 (PMLR, Los Angeles, CA, 2016).

    Not in our library

  33. 33.

    Suresh, H. et al. Clinical intervention prediction and understanding using deep networks. arXiv [cs.LG] (PMLR, Los Angeles, CA, USA, 2017).

    Not in our library

  34. 34.

    Razavian, N., Marcus, J. & Sontag, D. Multi-task prediction of disease onsets from longitudinal laboratory tests. In Proceedings of the 1st Machine Learning for Healthcare Conference, (eds F. Doshi-Velez, J. Fackler, D. Kale and B. Wallace, J. Wiens) Vol. 56, pp 73–100 (PMLR, Los Angeles, CA, 2016).

    Not in our library

  35. 35.
    Recurrent Neural Networks for Multivariate Time Series with Missing Values · 2018
    No notice
  36. 36.
    MIMIC-III, a freely accessible critical care database · 2016
    No notice
  37. 37.
    Multitask learning and benchmarking with clinical time series data · 2019
    No notice
  38. 38.

    Society of Critical Care Medicine. Critical care statistics. Available at: http://www.sccm.org/Communications/Pages/CriticalCareStats.aspx (Accessed 25 Jan 2018).

    Not in our library

  39. 39.

    American Hospital Association. Fast facts on U.S. Hospitals, 2018. Available at: https://www.aha.org/statistics/fast-facts-us-hospitals (Accessed 25 Jan 2018).

    Not in our library

  40. 40.

    Shickel, B., Tighe, P., Bihorac, A. & Rashidi, P. Deep EHR: a survey of recent advances in deep learning techniques for electronic health record (EHR) analysis. arXiv [cs.LG] (2017).

    Not in our library10.1109/jbhi.2017.2767063

All 89 references

Cited by papers we hold 34

and 14 more

Reads

Read by people on this page

None yet.

Checked or read by AI through naulon

None yet.

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.

Are you an author?

Is this your paper?

Claim it to add your note and be paid when agents cite it. Free.