Predicting COVID-19 Pneumonia Severity on Chest X-ray With Deep Learning

Abstract

Introduction The need to streamline patient management for coronavirus disease-19 (COVID-19) has become more pressing than ever. Chest X-rays (CXRs) provide a non-invasive (potentially bedside) tool to monitor the progression of the disease. In this study, we present a severity score prediction model for COVID-19 pneumonia for frontal chest X-ray images. Such a tool can gauge the severity of COVID-19 lung infections (and pneumonia in general) that can be used for escalation or de-escalation of care as well as monitoring treatment efficacy, especially in the ICU. Methods Images from a public COVID-19 database were scored retrospectively by three blinded experts in terms of the extent of lung involvement as well as the degree of opacity. A neural network model that was pre-trained on large (non-COVID-19) chest X-ray datasets is used to construct features for COVID-19 images which are predictive for our task. Results This study finds that training a regression model on a subset of the outputs from this pre-trained chest X-ray model predicts our geographic extent score (range 0-8) with 1.14 mean absolute error (MAE) and our lung opacity score (range 0-6) with 0.78 MAE. Conclusions These results indicate that our model's ability to gauge the severity of COVID-19 lung infections could be used for escalation or de-escalation of care as well as monitoring treatment efficacy, especially in the ICU. To enable follow up work, we make our code, labels, and data available online.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 30

1. 1.

   Wilson J, Moulson G. Children in Spain allowed to play outdoors as country eases COVID-19 lockdown. Global News. 2020.

   Not in our library

2. 2.

   O’Grady S, Noack R, Mettler K, et al. U.S. records more than 2,000 coronavirus deaths in one day, global death toll reaches 100,000. Washington Post. 2020.

   Not in our library

3. 3.

   Yoon SH, Lee KH, Kim JY, et al. Chest radiographic and CT findings of the 2019 novel coronavirus disease (COVID-19): analysis of nine patients treated in Korea. Korean J Radiol. 2020;21:494-500.

   Not in our library10.3348/kjr.2020.0132

4. 4.

   Ng MY, Lee EYP, Yang J, et al. Imaging profile of the COVID-19 infection: radiologic findings and literature review. Radiology. 2020;2:1.

   Not in our library10.1148/ryct.2020200034

5. 5.
   A rapid advice guideline for the diagnosis and treatment of 2019 novel coronavirus (2019-nCoV) infected pneumonia (standard version) · 2020

   No notice
6. 6.

   Strickland E Al. AI can help hospitals triage COVID-19 patients. IEEE Spectrum. 2020.

   Not in our library

7. 7.

   Cohen JP, Morrison P, Dao L. COVID-19 image data collection. arXiv:2003.11597. 2020.

   Not in our library

8. 8.

   Wong HYF, Lam HYS, Fong AHT, et al. Frequency and distribution of chest radiographic findings in patients positive for COVID-19. Radiology. 2020;296:0.

   Not in our library10.1148/radiol.2020201160

9. 9.

   Shih G, Wu C, Halabi S, et al. Augmenting the National Institutes of Health chest radiograph dataset with expert annotations of possible pneumonia. Radiology. 2020;1:1.

   Not in our library10.1148/ryai.2019180041

10. 10.

    Irvin J, Rajpurkar P, Ko M, et al. Chexpert: a large chest radiograph dataset with uncertainty labels and expert comparison. AAAI Conference on Artificial Intelligence. 2019.

    Not in our library

11. 11.

    Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. Chest X-ray: hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. Computer Vision and Pattern Recognition. 2017.

    Not in our library

12. 12.

    Majkowska A, Mittal S, Steiner DF, et al. Chest radiograph interpretation with deep learning models: assessment with radiologist-adjudicated reference standards and population-adjusted evaluation. Radiology. 2019;294:421-431.

    Not in our library10.1148/radiol.2019191293

13. 13.
    MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports · 2019

    No notice
14. 14.

    Bustos A, Pertusa A, Salinas JM, de la Iglesia-Vayá M. PadChest: A large chest x-ray image dataset with multi-label annotated reports. arXiv:1901.07441. 2019.

    Not in our library10.1016/j.media.2020.101797

15. 15.

    Demner-Fushman D, Kohli MD, Rosenman MB, et al. Preparing a collection of radiology examinations for distribution and retrieval. J Am Med Inform Assoc. 2016;23:304-310.

    Not in our library10.1093/jamia/ocv080

16. 16.

    Huang G, Liu Z, van der Maaten L, Weinberger KQ. Densely connected convolutional networks. Computer Vision and Pattern Recognition. 2017.

    Not in our library

17. 17.

    Cohen JP, Viviano J, Hashir M, Bertrand H. TorchXRayVision: a library of chest X-ray datasets and models. 2020. 2020.

    Not in our library

18. 18.

    Cohen JP, Hashir M, Brooks R, Bertrand H. On the limits of cross-domain generalization in automated X-ray prediction. Medical Imaging with Deep Learning. 2020.

    Not in our library

19. 19.

    Rajpurkar P, Irvin J, Zhu K, et al. CheXNet: radiologist-level pneumonia detection on chest X-rays with deep learning. arXiv:1711.05225. 2017.

    Not in our library

20. 20.

    Reed RD, Marks RJ. Neural Smithing: Supervised Learning in Feedforward Artificial Neural Networks. 1999.

    Not in our library

21. 21.
    Variable generalization performance of a deep learning model to detect pneumonia in chest radiographs: A cross-sectional study · 2018

    No notice
22. 22.

    Viviano JD, Simpson B, Dutil F, Bengio Y, Cohen JP. Underwhelming generalization improvements from controlling feature attribution. arXiv:1910.00199. 2019.

    Not in our library

23. 23.

    Ross A, Hughes MC, Doshi-Velez F. Right for the right reasons: training differentiable models by constraining their explanations. International Joint Conference on Artificial Intelligence. 2017.

    Not in our library

24. 24.

    van der Maaten L, Hinton G. Visualizing data using t-SNE. J Mach Learn Res. 2008;9:2579-2605.

    Not in our library

25. 25.
    Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal · 2020

    No notice
26. 26.

    Ross C. Hospitals are using AI to predict the decline of Covid-19 patients — before knowing it works. STAT News. 2020.

    Not in our library

27. 27.

    Ghassemi M, Naumann T, Schulam P, Beam AL, Chen IY, Ranganath R. Practical guidance on artificial intelligence for health-care data. Lancet. 2019;1:0.

    Not in our library10.1016/s2589-7500(19)30084-6

28. 28.

    Nagendran M, Chen Y, Lovejoy CA, et al. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. BMJ. 2020;368:0.

    Not in our library10.1136/bmj.m689

29. 29.

    Toussie D, Voutsinas N, Finkelstein M, et al. Clinical and chest radiography features determine patient outcomes in young and middle age adults with COVID-19. Radiology. 2020.

    Not in our library10.1148/radiol.2020201754

30. 30.

    Rubin GD, Ryerson CJ, Haramati LB, et al. The role of chest imaging in patient management during the COVID-19 pandemic: a multinational consensus statement from the Fleischner society. Radiology. 2020;296:172-180.

    Not in our library10.1148/radiol.2020201365

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.