COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images

Abstract

The Coronavirus Disease 2019 (COVID-19) pandemic continues to have a devastating effect on the health and well-being of the global population. A critical step in the fight against COVID-19 is effective screening of infected patients, with one of the key screening approaches being radiology examination using chest radiography. It was found in early studies that patients present abnormalities in chest radiography images that are characteristic of those infected with COVID-19. Motivated by this and inspired by the open source efforts of the research community, in this study we introduce COVID-Net, a deep convolutional neural network design tailored for the detection of COVID-19 cases from chest X-ray (CXR) images that is open source and available to the general public. To the best of the authors’ knowledge, COVID-Net is one of the first open source network designs for COVID-19 detection from CXR images at the time of initial release. We also introduce COVIDx, an open access benchmark dataset that we generated comprising of 13,975 CXR images across 13,870 patient patient cases, with the largest number of publicly available COVID-19 positive cases to the best of the authors’ knowledge. Furthermore, we investigate how COVID-Net makes predictions using an explainability method in an attempt to not only gain deeper insights into critical factors associated with COVID cases, which can aid clinicians in improved screening, but also audit COVID-Net in a responsible and transparent manner to validate that it is making decisions based on relevant information from the CXR images. By no means a production-ready solution, the hope is that the open access COVID-Net, along with the description on constructing the open source COVIDx dataset, will be leveraged and build upon by both researchers and citizen data scientists alike to accelerate the development of highly accurate yet practical deep learning solutions for detecting COVID-19 cases and accelerate treatment of those who need it the most.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 46

1. 1.

   Wang W, et al. Detection of SARS-CoV-2 in different types of clinical specimens. JAMA. 2020;323(18):1843-1844.

   Not in our library10.1001/jama.2020.3786 (opens in a new tab)

2. 2.

   West, C. P., Montori, V. M., & Sampathkumar, P. Covid-19 testing: the threat of false-negative results. In Mayo Clinic Proceeding (2020).

   Not in our library10.1016/j.mayocp.2020.04.004 (opens in a new tab)

3. 3.

   Fang, Y. et al. Sensitivity of chest CT for covid-19: comparison to RT-PCR. Radiology. 10.1148/radiol.2020200432 (2020).

   Not in our library10.1148/radiol.2020200432 (opens in a new tab)

4. 4.

   Yang, Y. et al. Evaluating the accuracy of different respiratory specimens in the laboratory diagnosis and monitoring the viral shedding of 2019-ncov infections. medRxiv:2020.02.11.20021493 (2020).

   Not in our library

5. 5.
   Estimating the false-negative test probability of SARS-CoV-2 by RT-PCR · 2020

   No notice
6. 6.

   Ng M-Y, et al. Imaging profile of the COVID-19 infection: radiologic findings and literature review. Radiol. Cardiothorac. Imaging. 2020;2(1):e200034.

   Not in our library10.1148/ryct.2020200034 (opens in a new tab)

7. 7.

   Huang C, et al. Clinical features of patients infected with 2019 Novel Coronavirus in Wuhan China. The Lancet. 2020;395:497-506.

   Not in our library10.1016/s0140-6736(20)30183-5 (opens in a new tab)

8. 8.

   Guan, W. J., Hu Y., & Ni Z. Y. Clinical characteristics of Coronavirus disease 2019 in China. N. Engl. J. Med.382(18), 1708–1720 (2020).

   Not in our library10.1056/nejmoa2002032 (opens in a new tab)

9. 9.

   Ai T, et al. Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in china: a report of 1014 cases. Radiology. 2020.

   Not in our library10.1148/radiol.2020200642 (opens in a new tab)

10. 10.

    Rubin GD, et al. The role of chest imaging in patient management during the COVID-19 pandemic: a multinational consensus statement from the fleischner society. Radiology. 2020.

    Not in our library10.1016/j.chest.2020.04.003 (opens in a new tab)

11. 11.

    Nair A, et al. A British Society of thoracic imaging statement: considerations in designing local imaging diagnostic algorithms for the COVID-19 pandemic. Clin. Radiol. 2020;75(5):329-334.

    Not in our library10.1016/j.crad.2020.03.008 (opens in a new tab)

12. 12.

    Dennie C, et al. The Canadian Society of Thoracic Radiology (CSTR) and Canadian Association of Radiologists (CAR) consensus statement regarding chest imaging in suspected and confirmed COVID-19. Can. Assoc. Radiol. J. 2020;71(4):470-481.

    Not in our library10.1177/0846537120924606 (opens in a new tab)

13. 13.

    Jacobi A, Chung M, Bernheim A, Eber C. Portable chest x-ray in coronavirus disease-19 (covid-19): a pictorial review. Clin. Imaging. 2020.

    Not in our library10.1016/j.clinimag.2020.04.001 (opens in a new tab)

14. 14.

    Wu, G., & Li, X. Mobile x-rays are highly valuable for critically ill covid patients. Eur. Radiol.. 10.1007/s00330-020-06918-2(2020).

    Not in our library10.1007/s00330-020-06918-2 (opens in a new tab)

15. 15.

    Mao, B. et al. Assessing risk factors for SARS-CoV-2 infection in patients presenting with symptoms in Shanghai, China: a multicentre observational cohort study. Lancet Dig. Health. 10.1016/S2589-7500(20)30109-6(2020).

    Not in our library10.1016/s2589-7500(20)30109-6 (opens in a new tab)

16. 16.

    Cohen, J. P., Morrison, P., & Dao, L. COVID-19 image data collection. arXiv:2003.11597 (2020).

    Not in our library

17. 17.

    Chung, A. Figure 1 COVID-19 chest x-ray data initiative. https://github.com/agchung/Figure1-COVID-chestxray-dataset (2020).

    Not in our library

18. 18.

    Chung, A. Actualmed COVID-19 chest x-ray data initiative. https://github.com/agchung/Actualmed-COVID-chestxray-dataset (2020).

    Not in our library

19. 19.

    Radiological Society of North America. COVID-19 radiography database. https://www.kaggle.com/tawsifurrahman/covid19-radiography-database (2019).

    Not in our library

20. 20.

    Radiological Society of North America. RSNA pneumonia detection challenge. https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data (2019).

    Not in our library10.2214/ajr.19.21512 (opens in a new tab)

21. 21.
    Deep learning · 2015

    No notice
22. 22.

    Gozes, O. et al. Rapid AI development cycle for the coronavirus (COVID-19) pandemic: initial results for automated detection and patient monitoring using deep learning ct image analysis. arXiv:2003.05037 (2020).

    Not in our library

23. 23.

    Xu, X. et al. Deep learning system to screen coronavirus disease 2019 pneumonia. arXiv:2002.09334 (2020).

    Not in our library

24. 24.

    Li, L. et al. Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT. Radiology. 10.1148/radiol.2020200905 (2020).

    Not in our library10.1148/radiol.2020200905 (opens in a new tab)

25. 25.

    Shi, F. et al. Large-scale screening of covid-19 from community acquired pneumonia using infection size-aware classification. arXiv:2003.09860 (2020).

    Not in our library10.1088/1361-6560/abe838 (opens in a new tab)

26. 26.

    Li, X., Li, C., & Zhu, D. Covid-mobilexpert: On-device covid-19 screening using snapshots of chest x-ray. arXiv:2004.03042 (2020).

    Not in our library

27. 27.

    Minaee, S., Kafieh, R., Sonka, M., Yazdani, S., & Soufi, G. J. Deep-covid: predicting covid-19 from chest x-ray images using deep transfer learning. arXiv:2004.09363 (2020).

    Not in our library10.1016/j.media.2020.101794 (opens in a new tab)

28. 28.

    Afshar, P. et al. Covid-caps: a capsule network-based framework for identification of covid-19 cases from x-ray images. arXiv:2004.02696 (2020).

    Not in our library10.1016/j.patrec.2020.09.010 (opens in a new tab)

29. 29.

    Luz, E. et al. Towards an effective and efficient deep learning model for covid-19 patterns detection in x-ray images. arXiv:2004.05717 (2020).

    Not in our library

30. 30.

    Khobahi, S., Agarwal, C., & Soltanalian, M. Coronet: a deep network architecture for semi-supervised task-based identification of covid-19 from chest x-ray images. medRxiv. 10.1101/2020.04.14.20065722 (2020).

    Not in our library

31. 31.

    Ucar, F., & Korkmaz, D. COVIDiagnosis-net: deep bayes-squeezenet based diagnosis of the coronavirus disease 2019 (COVID-19) from x-ray images. Med. Hypotheses. 10.1016/j.mehy.2020.109761 (2020).

    Not in our library10.1016/j.mehy.2020.109761 (opens in a new tab)

32. 32.

    Tartaglione, E., Barbano, C. A., Berzovini, C., Calandri, M., & Grangetto, M. Unveiling covid-19 from chest x-ray with deep learning: a hurdles race with small data. arXiv:2004.05405 (2020).

    Not in our library10.3390/ijerph17186933 (opens in a new tab)

33. 33.

    Yeh, C.-F. et al. A cascaded learning strategy for robust covid-19 pneumonia chest x-ray screening. arXiv:2004.12786 (2020).

    Not in our library

34. 34.

    Zhang, Y. et al. Covid-da: deep domain adaptation from typical pneumonia to covid-19. arXiv:2005.01577 (2020).

    Not in our library

35. 35.

    Karim, M. R. et al. Deepcovidexplainer: explainable covid-19 predictions based on chest x-ray images (2020).

    Not in our library

36. 36.

    Apostolopoulos, I. D., & Mpesiana, T. A. Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Phys. Eng. Sci. Med.43, 635–640. 10.1007/s13246-020-00865-4 (2020).

    Not in our library10.1007/s13246-020-00865-4 (opens in a new tab)

37. 37.

    Farooq, M., & Hafeez, A. Covid-resnet: a deep learning framework for screening of covid19 from radiographs (2020).

    Not in our library

38. 38.

    Majeed, T., Rashid, R., Ali, D., & Asaad, A. Covid-19 detection using cnn transfer learning from x-ray images. medRxiv (2020).

    Not in our library

39. 39.

    Wang, X. et al. Chestx-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In 2017 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 3462–3471 (2017).

    Not in our library

40. 40.

    He, K., Zhang, X., Ren, S., & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 770–778 (2016).

    Not in our library

41. 41.

    Wong, A., Shafiee, M. J., Chwyl, B., & Li, F. Ferminets: learning generative machines to generate efficient neural networks via generative synthesis. arXiv preprint arXiv:1809.05989 (2018).

    Not in our library

42. 42.

    Huang, G., Liu, Z., & Weinberger, K. Q. Densely connected convolutional networks. arXiv preprint arXiv:1608.06993 (2016).

    Not in our library

43. 43.

    Deng, J. et al. Imagenet: a large-scale hierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition 248–255 (IEEE, 2009).

    Not in our library

44. 44.

    Lin, Z. Q. et al. Do explanations reflect decisions? A machine-centric strategy to quantify the performance of explainability algorithms. arXiv preprint arXiv:1910.07387 (2019).

    Not in our library

45. 45.

    Wong, A. Netscore: towards universal metrics for large-scale performance analysis of deep neural networks for practical usage. CoRR. arXiv preprint arXiv:abs/1806.05512 (2018).

    Not in our library

46. 46.

    Simonyan, K., & Zisserman, A. Very deep convolutional networks for large-scale image recognition (2014).

    Not in our library

Cited by papers we hold 20

• Machine-Learning-Based Disease Diagnosis: A Comprehensive Review · 2022
  No notice
• A Novel Deep Learning and Ensemble Learning Mechanism for Delta-Type COVID-19 Detection · 2022
  Not checked
• A comparison of Covid-19 early detection between convolutional neural networks and radiologists · 2022
  Not checked
• Sense and Learn: Recent Advances in Wearable Sensing and Machine Learning for Blood Glucose Monitoring and Trend-Detection · 2022
  Not checked
• Unbox the black-box for the medical explainable AI via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond · 2022
  No notice
• Applications of Explainable Artificial Intelligence in Diagnosis and Surgery · 2022
  No notice
• A Review on Deep Learning Techniques for the Diagnosis of Novel Coronavirus (COVID-19) · 2021
  No notice
• RANDGAN: Randomized generative adversarial network for detection of COVID-19 in chest X-ray · 2021
  Not checked
• Fibrosis-Net: A Tailored Deep Convolutional Neural Network Design for Prediction of Pulmonary Fibrosis Progression From Chest CT Images · 2021
  Not checked
• A Systematic Review and Analysis on Deep Learning Techniques Used in Diagnosis of Various Categories of Lung Diseases · 2021
  Not checked
• COVID-19: A Review on the Novel Coronavirus Disease Evolution, Transmission, Detection, Control and Prevention · 2021
  No notice
• Benchmarking Methodology for Selection of Optimal COVID-19 Diagnostic Model Based on Entropy and TOPSIS Methods · 2020
  Not checked
• Artificial intelligence vs COVID-19: limitations, constraints and pitfalls · 2020
  No notice
• An Overview of Deep Learning Approaches in Chest Radiograph · 2020
  Not checked
• Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural network · 2020
  No notice
• Explainable Deep Learning Models in Medical Image Analysis · 2020
  No notice
• CovidGAN: Data Augmentation Using Auxiliary Classifier GAN for Improved Covid-19 Detection · 2020
  No notice
• Artificial Intelligence (AI) and Big Data for Coronavirus (COVID-19) Pandemic: A Survey on the State-of-the-Arts · 2020
  No notice
• COVID-19 Detection Through Transfer Learning Using Multimodal Imaging Data · 2020
  No notice
• Iteratively Pruned Deep Learning Ensembles for COVID-19 Detection in Chest X-Rays · 2020
  No notice

Questions about this paper

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.