Diagnosis of Alzheimer’s Disease via Multi-Modality 3D Convolutional Neural Network

Abstract

Alzheimer's disease (AD) is one of the most common neurodegenerative diseases. In the last decade, studies on AD diagnosis has attached great significance to artificial intelligence-based diagnostic algorithms. Among the diverse modalities of imaging data, T1-weighted MR and FDG-PET are widely used for this task. In this paper, we propose a convolutional neural network (CNN) to integrate all the multi-modality information included in both T1-MR and FDG-PET images of the hippocampal area, for the diagnosis of AD. Different from the traditional machine learning algorithms, this method does not require manually extracted features, instead, it utilizes 3D image-processing CNNs to learn features for the diagnosis or prognosis of AD. To test the performance of the proposed network, we trained the classifier with paired T1-MR and FDG-PET images in the ADNI datasets, including 731 cognitively unimpaired (labeled as CN) subjects, 647 subjects with AD, 441 subjects with stable mild cognitive impairment (sMCI) and 326 subjects with progressive mild cognitive impairment (pMCI). We obtained higher accuracies of 90.10% for CN vs. AD task, 87.46% for CN vs. pMCI task, and 76.90% for sMCI vs. pMCI task. The proposed framework yields a state-of-the-art performance. Finally, the results have demonstrated that (1) segmentation is not a prerequisite when using a CNN for the classification, (2) the combination of two modality imaging data generates better results.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 53

1. 1.

   Abadi M. Barham P. Chen J. Chen Z. Davis A. Dean J. (2016 ). “Tensorflow: a system for large-scale machine learning,” in Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation OSDI’16 Savannah, GA 265–283.

   Not in our library

2. 2.

   American Psychiatric Association (2013 ). Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Philadelphia: American Psychiatric Pub.

   Not in our library

3. 3.

   Ardekani B. A. Bermudez E. Mubeen A. M. Bachman A. H. Alzheimer’s Disease Neuroimaging Initiative. (2017 ). Prediction of incipient Alzheimer’s disease dementia in patients with mild cognitive impairment. J. Alzheimer’s Dis. 55 269–281.

   Not in our library10.3233/jad-160594

4. 4.

   Cabral C. Silveira M. (2013 ). “Classification of Alzheimer’s disease from FDG-PET images using favourite class ensembles,” in Proceedings of the 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Osaka: IEEE) 2477–2480.

   Not in our library10.1109/embc.2013.6610042

5. 5.
   Enhanced Data Representation by Kernel Metric Learning for Dementia Diagnosis · 2017

   Not checked
6. 6.

   Correa N. M. Li Y. O. Adali T. Calhoun V. D. (2009 ). “Fusion of fMRI, sMRI, and EEG data using canonical correlation analysis,” in Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing (Taipei: IEEE) 385–388.

   Not in our library

7. 7.

   Desikan R. S. Cabral H. J. Hess C. P. Dillon W. P. Glastonbury C. M. Weiner M. W. (2009 ). Automated MRI measures identify individuals with mild cognitive impairment and Alzheimer’s disease. Brain 132 2048–2057.

   Not in our library10.1093/brain/awp123

8. 8.

   Glenner G. Wong C. W. (1984 ). Alzheimer’s disease: initial report of the purification and characterization of a novel cerebrovascular amyloid protein. Biochem. Biophys. Res. Commun. 120 885–890.

   Not in our library10.1016/s0006-291x(84)80190-4

9. 9.

   Gray K. R. Aljabar P. Heckemann R. A. Hammers A. Rueckert D. (2013 ). Random forest-based similarity measures for multi-modal classification of Alzheimer’s disease. NeuroImage 65 167–175.

   Not in our library10.1016/j.neuroimage.2012.09.065

10. 10.

    Harada R. Okamura N. Furumoto S. Tago T. Maruyama M. Higuchi M. (2013 ). Comparison of the binding characteristics of [18 F] THK-523 and other amyloid imaging tracers to Alzheimer’s disease pathology. Eur. J. Nucl. Med. Mol. Imaging 40 125–132.

    Not in our library10.1007/s00259-012-2261-2

11. 11.

    He K. Gkioxari G. Dollár P. Girshick R. (2017 ). Mask r-cnn. arXiv

    Not in our library10.1109/tpami.2018.2844175

12. 12.

    Hill D. L. G. Schwarz A. J. Isaac M. Pani L. Vamvakas S. Hemmings R. (2014 ). Coalition against major diseases/european medicines agency biomarker qualification of hippocampal volume for enrichment of clinical trials in predementia stages of Alzheimer’s disease. Alzheimer’s Dement. 10 421–429.

    Not in our library10.1016/j.jalz.2013.07.003

13. 13.

    Hinton G. E. Srivastava N. Krizhevsky A. Sutskever I. Salakhutdinov R. R. (2015 ). Improving neural networks by preventing co-adaptation of feature detectors. arXiv

    Not in our library

14. 14.

    Hosseini-Asl E. Gimel’farb G. El-Baz A. (2016 ). Alzheimer’s disease diagnostics by a deeply supervised adaptable 3d convolutional network. arXiv

    Not in our library10.2741/4606

15. 15.

    Huang C. Wahlund L. O. Almkvist O. Elehu D. Svensson L. Jonsson T. (2003 ). Voxel-and VOI-based analysis of SPECT CBF in relation to clinical and psychological heterogeneity of mild cognitive impairment. Neuroimage 19 1137–1144.

    Not in our library10.1016/s1053-8119(03)00168-x

16. 16.

    Ioffe S. Szegedy C. (2015 ). Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv

    Not in our library

17. 17.

    Jack C. R. Jr. Albert M. S. Knopman D. S. McKhann G. M. Sperling R. A. Carrillo M. C. (2011a ). Introduction to the recommendations from the national institute on aging-alzheimer’s association workgroups on diagnostic guidelines for alzheimer’s disease. Alzheimer’s Dement. 7 257–262.

    Not in our library10.1016/j.jalz.2011.03.004

18. 18.

    Jack C. R. Jr. Barkhof F. Bernstein M. A. Cantillon M. Cole P. E. DeCarli C. (2011b ). Steps to standardization and validation of hippocampal volumetry as a biomarker in clinical trials and diagnostic criterion for Alzheimer’s disease. Alzheimer’s Dement. 7 474–485.

    Not in our library10.1016/j.jalz.2011.04.007

19. 19.

    Jack C. R. Jr. Bernstein M. A. Fox N. C. Thompson P. Alexander G. Harvey D. (2008a ). The Alzheimer’s disease neuroimaging initiative (ADNI): MRI methods. J. Mag. Reson. Imag. 27 685–691.

    Not in our library10.1002/jmri.21049

20. 20.

    Jack C. R. Jr. Lowe V. J. Senjem M. L. Weigand S. D. Kemp B. J. Shiung M. M. (2008b ). 11C PiB and structural MRI provide complementary information in imaging of Alzheimer’s disease and amnestic mild cognitive impairment. Brain 131 665–680.

    Not in our library10.1093/brain/awm336

21. 21.

    Jetley S. Lord N. A. Lee N. Torr P. H. S. (2018 ). Learn to pay attention. arXiv

    Not in our library

22. 22.

    Jie B. Zhang D. Cheng B. Shen D. (2015 ). Manifold regularized multitask feature learning for multimodality disease classification. Hum. Brain Mapp. 36 489–507.

    Not in our library10.1002/hbm.22642

23. 23.

    Kingma D. P. Ba J. (2014 ). Adam: a method for stochastic optimization. arXiv

    Not in our library10.1002/mp.13112

24. 24.

    Krizhevsky A. Sutskever I. Hinton G. E. (2012 ). Imagenet classification with deep convolutional neural networks. Adv. Neural Inform. Process. Syst. 25 1097–1105.

    Not in our library

25. 25.

    Lebedeva A. K. Westman E. Borza T. Beyer M. K. Engedal K. Aarsland D. (2017 ). MRI-based classification models in prediction of mild cognitive impairment and dementia in late-life depression. Front. Aging Neurosci. 9:13

    Not in our library10.3389/fnagi.2017.00013

26. 26.

    LeCun Y. Jackel L. D. Bottou L. Cortes C. Denker J. S. Drucker H. (1995 ). “Learning algorithms for classification: A comparison on handwritten digit recognition,” in Neural Networks: The Statistical Mechanics Perspective eds Oh J. H. Kwon C. Cho S. (Singapore: World Scientific) 261–276.

    Not in our library

27. 27.

    Ledig C. Heckemann R. A. Hammers A. Lopez J. C. Newcombe V. F. J. Makropoulos A. (2015 ). Robust whole-brain segmentation: application to traumatic brain injury. Med. Image Anal. 21 40–58.

    Not in our library10.1016/j.media.2014.12.003

28. 28.

    Li R. Zhang W. Suk H. I. Wang L. Li J. Shen D. (2014 ). “Deep learning based imaging data completion for improved brain disease diagnosis,” in Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention (Cham: Springer) 305–312.

    Not in our library10.1007/978-3-319-10443-0_39

29. 29.
    Convolutional Neural Networks-Based MRI Image Analysis for the Alzheimer’s Disease Prediction From Mild Cognitive Impairment · 2018

    No notice
30. 30.

    Litjens G. Kooi T. Bejnordi B. E. Adiyoso Setio A. A. Ciompi F. Ghafoorian M. (2017 ). A survey on deep learning in medical image analysis. Med. Image Anal. 42 60–88.

    Not in our library10.1016/j.media.2017.07.005

31. 31.

    Liu M. Cheng D. Wang K. Wang Y. (2018 ). Multi-modality cascaded convolutional neural networks for alzheimer’s disease diagnosis. Neuroinformatics 16 295–308.

    Not in our library10.1007/s12021-018-9370-4

32. 32.

    Liu S. Liu S. Cai W. Che H. Pujol S. Kikinis R. (2015 ). Multimodal neuroimaging feature learning for multiclass diagnosis of Alzheimer’s disease. IEEE Trans. Biomed. Eng. 62 1132–1140.

    Not in our library10.1109/tbme.2014.2372011

33. 33.

    Mosconi L. De Santi S. Li Y. Zhan J. Tsui W. H. Boppana M. (2006 ). Visual rating of medial temporal lobe metabolism in mild cognitive impairment and Alzheimer’s disease using FDG-PET. Eur. J. Nucl. Med. Mol. Imaging 33 210–221.

    Not in our library10.1007/s00259-005-1956-z

34. 34.

    Mosconi L. Tsui W. H. Herholz K. Pupi A. Drzezga A. Lucignani G. (2008 ). Multicenter standardized 18F-FDG PET diagnosis of mild cognitive impairment, Alzheimer’s disease, and other dementias. J. Nuclear Med. 49:390

    Not in our library10.2967/jnumed.107.045385

35. 35.

    Patterson C. (2018 ). World Alzheimer Report 2018 The State of the Art of Dementia Research: New frontiers. London: Alzheimer’s Disease International (ADI).

    Not in our library

36. 36.

    Petersen R. C. Lopez O. Armstrong M. J. Getchius T. S. D. Ganguli M. Gloss D. (2018 ). Practice guideline update summary: mild cognitive impairment: report of the guideline development, dissemination, and implementation subcommittee of the American academy of neurology. Neurology 90 126–135.

    Not in our library10.1212/wnl.0000000000004826

37. 37.

    Petersen R. C. Smith G. E. Waring S. C. (1999 ). Mild cognitive impairment: clinical characterization and outcome. Arch. Neurol. 56 303–308.

    Not in our library10.1001/archneur.56.3.303

38. 38.

    Ren S. He K. Girshick R. Sun J. (2015 ). “Faster r-cnn: Towards real-time object detection with region proposal networks,” in Proceedings of the IEEE Transactions on Pattern Analysis and Machine Intelligence (Piscataway: IEEE).

    Not in our library10.1109/tpami.2016.2577031

39. 39.

    Rombouts S. A. R. B. Barkhof F. Goekoop R. Stam C. J. Scheltens P. (2005 ). Altered resting state networks in mild cognitive impairment and mild Alzheimer’s disease: an fMRI study. Hum. Brain Mapp. 26 231–239.

    Not in our library10.1002/hbm.20160

40. 40.

    Rondina J. M. Ferreira L. K. de Souza Duran F. L. Kubo R. Ono C. R. Leite C. C. (2018 ). Selecting the most relevant brain regions to discriminate Alzheimer’s disease patients from healthy controls using multiple kernel learning: a comparison across functional and structural imaging modalities and atlases. NeuroImage Clin. 17 628–641.

    Not in our library10.1016/j.nicl.2017.10.026

41. 41.

    Russakovsky O. Deng J. Su H. Krause J. Satheesh S. Ma S. (2015 ). Imagenet large scale visual recognition challenge. Int. J. Comp. Vis. 115 211–252.

    Not in our library10.1007/s11263-015-0816-y

42. 42.

    Samper-González J. Burgos N. Bottani S. Fontanella S. Lu P. Marcoux A. (2018 ). Reproducible evaluation of classification methods in Alzheimer’s disease: framework and application to MRI and PET data. bioRxiv

    Not in our library10.1016/j.neuroimage.2018.08.042

43. 43.

    Sarraf S. Tofighi G. (2016 ). Classification of alzheimer’s disease using fmri data and deep learning convolutional neural networks. arXiv

    Not in our library

44. 44.

    Silveira M. Marques J. (2010 ). “Boosting Alzheimer disease diagnosis using PET images,” in Proceedings of the 2010 20th International Conference on Pattern Recognition (Istanbul: IEEE) 2556–2559.

    Not in our library

45. 45.

    Simonyan K. Zisserman A. (2014 ). Very deep convolutional networks for large-scale image recognition. arXiv

    Not in our library

46. 46.
    Differential diagnosis of mild cognitive impairment and Alzheimer's disease using structural MRI cortical thickness, hippocampal shape, hippocampal texture, and volumetry · 2017

    Not checked
47. 47.

    Tong T. Gray K. Gao Q. Chen L. Rueckert D. (2017 ). Multi-modal classification of Alzheimer’s disease using nonlinear graph fusion. Patt. Recogn. 63 171–181.

    Not in our library10.1016/j.patcog.2016.10.009

48. 48.

    Wang P. Chen K. Yao L. Hu B. Wu X. Zhang J. (2016 ). Multimodal classification of mild cognitive impairment based on partial least squares. J. Alzheimer’s Dis. 54 359–371.

    Not in our library10.3233/jad-160102

49. 49.

    World Health Organization (2012 ). Dementia: a Public Health Priority. Geneva: World Health Organization.

    Not in our library

50. 50.

    Zhang D. Wang Y. Zhou L. Yuan H. Shen D. (2011 ). Multimodal classification of Alzheimer’s disease and mild cognitive impairment. Neuroimage 55 856–867.

    Not in our library10.1016/j.neuroimage.2011.01.008

51. 51.

    Zhang S. Smailagic N. Hyde C. Noel-Storr A. H. Takwoingi Y. McShane R. (2014 ). 11 C-PIB-PET for the early diagnosis of Alzheimer’s disease dementia and other dementias in people with mild cognitive impairment (MCI). Coch. Database Syst. Rev. 2014:CD010386.

    Not in our library10.1002/14651858.cd010386.pub2

52. 52.

    Zhuang X. Arridge S. Hawkes D. J. Ourselin S. (2011 ). A nonrigid registration framework using spatially encoded mutual information and free-form deformations. IEEE Trans. Med. Imaging 30 1819–1828.

    Not in our library10.1109/tmi.2011.2150240

53. 53.

    Zu C. Jie B. Liu M. Chen S. Shen D. Zhang D. (2016 ). Label-aligned multi-task feature learning for multimodal classification of Alzheimer’s disease and mild cognitive impairment. Brain Imaging Behav. 10 1148–1159.

    Not in our library10.1007/s11682-015-9480-7

Cited by papers we hold 1

• Convolutional neural network for the diagnosis of early gastric cancer based on magnifying narrow band imaging · 2019
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.