Towards automatic pulmonary nodule management in lung cancer screening with deep learning

Abstract

The introduction of lung cancer screening programs will produce an unprecedented amount of chest CT scans in the near future, which radiologists will have to read in order to decide on a patient follow-up strategy. According to the current guidelines, the workup of screen-detected nodules strongly relies on nodule size and nodule type. In this paper, we present a deep learning system based on multi-stream multi-scale convolutional networks, which automatically classifies all nodule types relevant for nodule workup. The system processes raw CT data containing a nodule without the need for any additional information such as nodule segmentation or nodule size and learns a representation of 3D data by analyzing an arbitrary number of 2D views of a given nodule. The deep learning system was trained with data from the Italian MILD screening trial and validated on an independent set of data from the Danish DLCST screening trial. We analyze the advantage of processing nodules at multiple scales with a multi-stream convolutional network architecture, and we show that the proposed deep learning system achieves performance at classifying nodule type that surpasses the one of classical machine learning approaches and is within the inter-observer variability among four experienced human observers.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 34

1. 1.

   Aberle D. R.. Reduced lung-cancer mortality with low-dose computed tomographic screening. New England Journal of Medicine 365, 395–409 (2011 ).

   Not in our library10.1056/nejmoa1102873

2. 2.

   de Koning H. J.. Benefits and harms of computed tomography lung cancer screening strategies: A comparative modeling study for the U.S. preventive services task force. Annals of Internal Medicine (2013 ).

   Not in our library10.7326/m13-2316

3. 3.

   Messay T., Hardie R. C. & Rogers S. K. A new computationally efficient CAD system for pulmonary nodule detection in CT imagery. Medical Image Analysis 14, 390–406 (2010 ).

   Not in our library10.1016/j.media.2010.02.004

4. 4.

   Jacobs C.. Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images. Medical Image Analysis 18, 374–384 (2014 ).

   Not in our library10.1016/j.media.2013.12.001

5. 5.

   Setio A. A. A., Jacobs C., Gelderblom J. & van Ginneken B. Automatic detection of large pulmonary solid nodules in thoracic CT images. Medical Physics 42, 5642–5653 (2015 ).

   Not in our library10.1118/1.4929562

6. 6.

   Setio A. A. A.. Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Transactions on Medical Imaging 35, 1160–1169 (2016 ).

   Not in our library10.1109/tmi.2016.2536809

7. 7.

   McWilliams A.. Probability of cancer in pulmonary nodules detected on first screening CT. New England Journal of Medicine 369, 910–919 (2013 ).

   Not in our library10.1056/nejmoa1214726

8. 8.

   de Hoop B., van Ginneken B., Gietema H. & Prokop M. Pulmonary perifissural nodules on CT scans: Rapid growth is not a predictor of malignancy. Radiology 265, 611–616 (2012 ).

   Not in our library10.1148/radiol.12112351

9. 9.

   Henschke C. I.. CT screening for lung cancer: Frequency and significance of part-solid and nonsolid nodules. American Journal of Roentgenology 178, 1053–1057 (2002 ).

   Not in our library10.2214/ajr.178.5.1781053

10. 10.

    van Riel S. J.. Observer variability for classification of pulmonary nodules on low-dose CT images and its effect on nodule management. Radiology 277, 863–871 (2015 ).

    Not in our library10.1148/radiol.2015142700

11. 11.

    Jacobs C.. Solid, part-solid, or non-solid?: Classification of pulmonary nodules in low-dose chest computed tomography by a computer-aided diagnosis system. Investigative Radiology 50, 168–173 (2015 ).

    Not in our library10.1097/rli.0000000000000121

12. 12.

    Farag A., Elhabian S., Graham J., Farag A. & Falk R. Toward precise pulmonary nodule descriptors for nodule type classification. Medical Image Computing and Computer-Assisted Intervention 13, 626–633 (2010 ).

    Not in our library10.1007/978-3-642-15711-0_78

13. 13.

    Ciompi F.. Bag of frequencies: a descriptor of pulmonary nodules in computed tomography images. IEEE Transactions on Medical Imaging 34, 1–12 (2015 ).

    Not in our library10.1109/tmi.2014.2371821

14. 14.

    Ciompi F.. Automatic detection of spiculation of pulmonary nodules in computed tomography images. In Medical Imaging, vol. 9414 of Proceedings of the SPIE (2015 ).

    Not in our library

15. 15.

    Ciompi F.. Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box. Medical Image Analysis 26, 195–202 (2015 ).

    Not in our library10.1016/j.media.2015.08.001

16. 16.
    Deep learning · 2015

    No notice
17. 17.

    Schmidhuber J. Deep learning in neural networks: an overview. Neural Networks 61, 85–117 (2015 ).

    Not in our library10.1016/j.neunet.2014.09.003

18. 18.

    Lecun Y., Bottou L., Bengio Y. & Haffner P. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86, 2278–2324 (1998 ).

    Not in our library

19. 19.

    Krizhevsky A., Sutskever I. & Hinton G. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems 25, 1097–1105 (2012 ).

    Not in our library

20. 20.

    Sermanet P.. OverFeat: Integrated recognition, localization and detection using convolutional networks. In International Conference on Learning Representations (ICLR 2014) ArXiv: 1312.6229 (2014 ).

    Not in our library

21. 21.

    Szegedy C.. Going deeper with convolutions. arXiv:14094842v1 (2014 ).

    Not in our library

22. 22.

    van Ginneken B., Setio A. A. A., Jacobs C. & Ciompi F. Off-the-shelf convolutional neural network features for pulmonary nodule detection in computed tomography scans. In IEEE International Symposium on Biomedical Imaging 286–289 (2015 ).

    Not in our library

23. 23.

    Sebastian Roberto Tarando A. F., Catalin Fetita & Brillet P.-Y. Increasing cad system efficacy for lung texture analysis using a convolutional network. In Medical Imaging, Proceedings of the SPIE (2016 ).

    Not in our library

24. 24.

    Anthimopoulos M., Christodoulidis S., Ebner L., Christe A. & Mougiakakou S. Lung pattern classification for interstitial lung diseases using a deep convolutional neural network 35, 1207–1216 (2016 ).

    Not in our library10.1109/tmi.2016.2535865

25. 25.

    Pastorino U.. Annual or biennial CT screening versus observation in heavy smokers: 5-year results of the MILD trial. European Journal of Cancer Prevention 21, 308–315 (2012 ).

    Not in our library10.1097/cej.0b013e328351e1b6

26. 26.

    Pedersen J. H.. The Danish randomized lung cancer CT screening trial-overall design and results of the prevalence round. Journal of Thoracic Oncology 4, 608–614 (2009 ).

    Not in our library10.1097/jto.0b013e3181a0d98f

27. 27.

    Kuhnigk J. M.. Morphological segmentation and partial volume analysis for volumetry of solid pulmonary lesions in thoracic CT scans. IEEE Transactions on Medical Imaging 25, 417–434 (2006 ).

    Not in our library10.1109/tmi.2006.871547

28. 28.

    Winkler Wille M. M.. Predictive accuracy of the pancan lung cancer risk prediction model -external validation based on CT from the danish lung cancer screening trial. European Radiology 25, 3093–3099 (2015 ).

    Not in our library10.1007/s00330-015-3689-0

29. 29.

    van der Maaten L. & Hinton G. Visualizing data using t-SNE. 2579–2605 (2008 ).

    Not in our library

30. 30.

    Simonyan K. & Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv:14091556 (2014 ).

    Not in our library

31. 31.

    Bastien F.. Theano: new features and speed improvements. Deep Learning and Unsupervised Feature Learning NIPS 2012 Workshop (2012 ).

    Not in our library

32. 32.

    Glorot X. & Bengio Y. Understanding the difficulty of training deep feedforward neural networks. In International conference on artificial intelligence and statistics 249–256 (2010 ).

    Not in our library

33. 33.

    Kingma D. & Ba J. ADAM: A method for stochastic optimization. arXiv:14126980 (2015 ).

    Not in our library

34. 34.

    Coates A., Lee H. & Ng A. Y. An analysis of single-layer networks in unsupervised feature learning. In Aistats (2011 ).

    Not in our library

Cited by papers we hold 6

• Automated coronary calcium scoring using deep learning with multicenter external validation · 2021
  No notice
• Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis · 2021
  No notice
• A Comprehensive Review of Computer-Aided Diagnosis of Pulmonary Nodules Based on Computed Tomography Scans · 2020
  Not checked
• Identifying Schizophrenia Using Structural MRI With a Deep Learning Algorithm · 2020
  Not checked
• Machine learning applications in prostate cancer magnetic resonance imaging · 2019
  No notice
• Artificial intelligence in cancer imaging: Clinical challenges and applications · 2019
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.