Deep Learning in Alzheimer's Disease: Diagnostic Classification and Prognostic Prediction Using Neuroimaging Data

Abstract

Deep learning, a state-of-the-art machine learning approach, has shown outstanding performance over traditional machine learning in identifying intricate structures in complex high-dimensional data, especially in the domain of computer vision. The application of deep learning to early detection and automated classification of Alzheimer's disease (AD) has recently gained considerable attention, as rapid progress in neuroimaging techniques has generated large-scale multimodal neuroimaging data. A systematic review of publications using deep learning approaches and neuroimaging data for diagnostic classification of AD was performed. A PubMed and Google Scholar search was used to identify deep learning papers on AD published between January 2013 and July 2018. These papers were reviewed, evaluated, and classified by algorithm and neuroimaging type, and the findings were summarized. Of 16 studies meeting full inclusion criteria, 4 used a combination of deep learning and traditional machine learning approaches, and 12 used only deep learning approaches. The combination of traditional machine learning for classification and stacked auto-encoder (SAE) for feature selection produced accuracies of up to 98.8% for AD classification and 83.7% for prediction of conversion from mild cognitive impairment (MCI), a prodromal stage of AD, to AD. Deep learning approaches, such as convolutional neural network (CNN) or recurrent neural network (RNN), that use neuroimaging data without pre-processing for feature selection have yielded accuracies of up to 96.0% for AD classification and 84.2% for MCI conversion prediction. The best classification performance was obtained when multimodal neuroimaging and fluid biomarkers were combined. Deep learning approaches continue to improve in performance and appear to hold promise for diagnostic classification of AD using multimodal neuroimaging data. AD research that uses deep learning is still evolving, improving performance by incorporating additional hybrid data types, such as-omics data, increasing transparency with explainable approaches that add knowledge of specific disease-related features and mechanisms.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 84

1. 1.

   Aderghal K. Benois-Pineau J. Afdel K. Catheline G. (2017 ). FuseMe: classification of sMRI images by fusion of deep CNNs in 2D+ϵ projections, in Proceedings of the 15th International Workshop on Content-Based Multimedia Indexing (New York, NY).

   Not in our library

2. 2.

   Alzheimer's Association (2018 ). 2018 Alzheimer's disease facts and figures. Alzheimer's Dementia 14, 367–429.

   Not in our library10.1016/j.jalz.2018.02.001 (opens in a new tab)

3. 3.

   Bengio Y. (2009 ). Learning deep architectures for AI. Found. Trends Mach. Learn. 2, 1–127.

   Not in our library10.1561/2200000006 (opens in a new tab)

4. 4.

   Bengio Y. (2013 ). Deep learning of representations: looking forward, in International Conference on Statistical Language and Speech Processing (Tarragona: Springer), 1–37.

   Not in our library

5. 5.

   Bengio Y. Courville A. Vincent P. (2013 ). Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1798–1828.

   Not in our library10.1109/tpami.2013.50 (opens in a new tab)

6. 6.

   Bishop C. M. (1995 ). Neural Networks for Pattern Recognition. New York, NY: Oxford University Press.

   Not in our library

7. 7.

   Bottou L. (2010 ). Large-scale machine learning with stochastic gradient descent, in Proceedings of COMPSTAT'2010 (Paris: Springer), 177–186.

   Not in our library

8. 8.

   Boureau Y.-L. Ponce J. Lecun Y. (2010 ). A theoretical analysis of feature pooling in visual recognition, in Proceedings of the 27th International Conference on Machine Learning (ICML-10) (Haifa), 111–118.

   Not in our library

9. 9.
   Chapter 11: Genome-Wide Association Studies · 2012

   No notice
10. 10.

    Cheng D. Liu M. (2017 ). CNNs based multi-modality classification for AD diagnosis, in 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI) (Shanghai), 1–5.

    Not in our library

11. 11.

    Cheng D. Liu M. Fu J. Wang Y. (2017 ). Classification of MR brain images by combination of multi-CNNs for AD diagnosis, in Ninth International Conference on Digital Image Processing (ICDIP 2017) (Hong Kong: SPIE), 5.

    Not in our library

12. 12.

    Choi H. Jin K. H. (2018 ). Predicting cognitive decline with deep learning of brain metabolism and amyloid imaging. Behav. Brain Res. 344, 103–109.

    Not in our library10.1016/j.bbr.2018.02.017 (opens in a new tab)

13. 13.

    Ciregan D. Meier U. Schmidhuber J. (2012 ). Multi-column deep neural networks for image classification, in 2012 IEEE Conference on Computer Vision and Pattern Recognition (Providence, RI), 3642–3649.

    Not in our library

14. 14.

    De strooper B. Karran E. (2016 ). The cellular phase of Alzheimer's disease. Cell 164, 603–615.

    Not in our library10.1016/j.cell.2015.12.056 (opens in a new tab)

15. 15.

    Farabet C. Couprie C. Najman L. Lecun Y. (2013 ). Learning hierarchical features for scene labeling. IEEE Trans. Pattern Anal. Mach. Intell. 35, 1915–1929.

    Not in our library10.1109/tpami.2012.231 (opens in a new tab)

16. 16.

    Fukushima K. (1975 ). Cognitron: a self-organizing multilayered neural network. Biol. Cybernet. 20, 121–136.

    Not in our library10.1007/bf00342633 (opens in a new tab)

17. 17.

    Fukushima K. (1979 ). Neural network model for a mechanism of pattern recognition unaffected by shift in position-Neocognitron. IEICE Tech. Rep. A 62, 658–665.

    Not in our library10.1007/bf00344251 (opens in a new tab)

18. 18.

    Fukushima K. (1980 ). Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193–202.

    Not in our library10.1007/bf00344251 (opens in a new tab)

19. 19.

    Galvin J. E. (2017 ). Prevention of Alzheimer's disease: lessons learned and applied. J. Am. Geriatr. Soc. 65, 2128–2133.

    Not in our library10.1111/jgs.14997 (opens in a new tab)

20. 20.

    Glorot X. Bordes A. Bengio Y. (2011 ). Deep sparse rectifier neural networks, in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics (Fort Lauderdale, FL), 315–323.

    Not in our library

21. 21.

    Goodfellow I. Bengio Y. Courville A. Bengio Y. (2016 ). Deep Learning. Cambridge, MA: MIT Press.

    Not in our library

22. 22.

    Goodfellow I. Pouget-Abadie J. Mirza M. Xu B. Warde-Farley D. Ozair S. (2014 ). Generative adversarial nets, in Advances in Neural Information Processing Systems 27, eds Ghahramani Z. Welling M. Cortes C. Lawrence N. D. Weinberger K. Q (Montreal, QC), 2672–2680.

    Not in our library

23. 23.

    Gulshan V. Peng L. Coram M. Stumpe MC Wu D Narayanaswamy A. (2016 ). Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402–2410.

    Not in our library10.1001/jama.2016.17216 (opens in a new tab)

24. 24.

    Hinton G. Deng L. Yu D. Dahl G. Mohamed A.-R. Jaitly N. (2012 ). Deep neural networks for acoustic modeling in speech recognition. IEEE Signal Process. Mag. 29, 82–97.

    Not in our library10.1109/msp.2012.2205597 (opens in a new tab)

25. 25.

    Hinton G. E. Osindero S. Teh Y.-W. (2006 ). A fast learning algorithm for deep belief nets. Neural Comput. 18, 1527–1554.

    Not in our library10.1162/neco.2006.18.7.1527 (opens in a new tab)

26. 26.

    Hinton G. E. Salakhutdinov R. R. (2006 ). Reducing the dimensionality of data with neural networks. Science 313, 504–507.

    Not in our library10.1126/science.1127647 (opens in a new tab)

27. 27.

    Hinton G. E. Zemel R. S. (1994 ). Autoencoders, minimum description length and Helmholtz free energy, in Advances in Neural Information Processing Systems 6, eds Cowan J. D. Tesauro G. Alspector J (Denver, CO), 3–10.

    Not in our library

28. 28.

    Hutson M. (2018 ). Artificial intelligence faces reproducibility crisis. Science 359, 725–726.

    Not in our library10.1126/science.359.6377.725 (opens in a new tab)

29. 29.

    Ivakhnenko A. G. (1968 ). The group method of data of handling; a rival of the method of stochastic approximation. Sov. Autom. Control 13, 43–55.

    Not in our library

30. 30.

    Ivakhnenko A. G. (1971 ). Polynomial theory of complex systems. IEEE Trans. Syst. Man Cybern. SMC-1, 364–378.

    Not in our library10.1109/tsmc.1971.4308320 (opens in a new tab)

31. 31.

    Ivakhnenko A. G. E. Lapa V. G. (1965 ). Cybernetic Predicting Devices. New York, NY: CCM Information Corporation.

    Not in our library

32. 32.

    König I. R. (2011 ). Validation in genetic association studies. Brief. Bioinformatics 12, 253–258.

    Not in our library10.1093/bib/bbq074 (opens in a new tab)

33. 33.

    Kononenko I. (2001 ). Machine learning for medical diagnosis: history, state of the art and perspective. Artif. Intell. Med. 23, 89–109.

    Not in our library10.1016/s0933-3657(01)00077-x (opens in a new tab)

34. 34.

    Korolev S. Safiullin A. Belyaev M. Dodonova Y. (2017 ). Residual and plain convolutional neural networks for 3D brain MRI classification, in 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017) (Melbourne, VIC), 835–838.

    Not in our library

35. 35.

    Krizhevsky A. Hinton G. E. (2011 ). Using very deep autoencoders for content-based image retrieval, in Proceedings of the 19th European Symposium on Artificial Neural Networks: ESANN 2011 (Bruges), 2.

    Not in our library

36. 36.

    Krizhevsky A. Sutskever I. Hinton G. E. (2012 ). Imagenet classification with deep convolutional neural networks, in Advances in Neural Information Processing Systems 25, eds Pereira F. Burges C. J. C. Bottou L. Weinberger K. Q (Stateline, NV), 1097–1105.

    Not in our library

37. 37.

    Larochelle H. Erhan D. Courville A. Bergstra J. Bengio Y. (2007 ). An empirical evaluation of deep architectures on problems with many factors of variation, in Proceedings of the 24th International Conference on Machine Learning (Corvallis, OR: ACM), 473–480.

    Not in our library

38. 38.
    Deep learning · 2015

    No notice
39. 39.

    Lecun Y. Touresky D. Hinton G. Sejnowski T. (1988 ). A theoretical framework for back-propagation, in Proceedings of the 1988 Connectionist Models Summer School: CMU (Pittsburgh, PA: Morgan Kaufmann), 21–28.

    Not in our library

40. 40.

    Li F. Tran L. Thung K.-H. Ji S. Shen D. Li J. (2015 ). A robust deep model for improved classification of AD/MCI patients. IEEE J. Biomed. Health Inform. 19, 1610–1616.

    Not in our library10.1109/jbhi.2015.2429556 (opens in a new tab)

41. 41.

    Li R. Zhang W. Suk H.-I. Wang L. Li J. Shen D. (2014 ). Deep learning based imaging data completion for improved brain disease diagnosis, in International Conference on Medical Image Computing and Computer-Assisted Intervention, Vol 17 (Boston, MA), 305–312.

    Not in our library10.1007/978-3-319-10443-0_39 (opens in a new tab)

42. 42.

    Litjens G. Kooi T. Bejnordi B. E. Setio A. A. A. Ciompi F.. (2017 ). A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88.

    Not in our library10.1016/j.media.2017.07.005 (opens in a new tab)

43. 43.
    Classification of Alzheimer’s Disease by Combination of Convolutional and Recurrent Neural Networks Using FDG-PET Images · 2018

    No notice
44. 44.

    Liu M. Zhang J. Adeli E. Shen D. (2018b ). Landmark-based deep multi-instance learning for brain disease diagnosis. Med. Image Anal. 43, 157–168.

    Not in our library10.1016/j.media.2017.10.005 (opens in a new tab)

45. 45.

    Liu S. Liu S. Cai W. Che H. Pujol S. Kikinis R.. (2015 ). Multimodal neuroimaging feature learning for multiclass diagnosis of Alzheimer's Disease. IEEE Trans. Biomed. Eng. 62, 1132–1140.

    Not in our library10.1109/tbme.2014.2372011 (opens in a new tab)

46. 46.

    Liu S. Liu S. Cai W. Pujol S. Kikinis R. Feng D. (2014 ). Early diagnosis of Alzheimer's disease with deep learning, in 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI) (Beijing), 1015–1018.

    Not in our library

47. 47.
    Multimodal and Multiscale Deep Neural Networks for the Early Diagnosis of Alzheimer’s Disease using structural MR and FDG-PET images · 2018

    No notice
48. 48.

    Lu D. Weng Q. (2007 ). A survey of image classification methods and techniques for improving classification performance. Int. J. Remote Sens. 28, 823–870.

    Not in our library10.1080/01431160600746456 (opens in a new tab)

49. 49.

    Makhzani A. Frey B. (2015 ). k-sparse autoencoders, in Advances in Neural Information Processing Systems 28 (Montreal, QC), 2791–2799.

    Not in our library

50. 50.

    Marcus G. (2018 ). Deep learning: a critical appraisal. arXiv preprint. arXiv:1801.00631.

    Not in our library

51. 51.

    Mcculloch W. S. Pitts W. (1943 ). A logical calculus of the ideas immanent in nervous activity. Bull. Math. Biophys. 5, 115–133.

    Not in our library10.1007/bf02478259 (opens in a new tab)

52. 52.

    Mikolov T. Sutskever I. Chen K. Corrado G. S. Dean J. (2013 ). Distributed representations of words and phrases and their compositionality, in Advances in Neural Information Processing Systems 26, eds Burges C. J. C. Bottou L. Welling M. Ghahramani Z. Weinberger K. Q (Stateline, NV), 3111–3119.

    Not in our library

53. 53.

    Minsky M. Papert S. (1969 ). Perceptrons. Cambridge, MA: MIT Press.

    Not in our library

54. 54.

    Moher D. Liberati A. Tetzlaff J. Altman D. G. (2009 ). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann. Intern. Med. 151, 264–269.

    Not in our library10.7326/0003-4819-151-4-200908180-00135 (opens in a new tab)

55. 55.

    Nair V. Hinton G. E. (2010 ). Rectified linear units improve restricted boltzmann machines, in Proceedings of the 27th International Conference on Machine Learning (ICML-10) (Haifa), 807–814.

    Not in our library

56. 56.

    Ngiam J. Khosla A. Kim M. Nam J. Lee H. Ng A. Y. (2011 ). Multimodal deep learning, in Proceedings of the 28th International Conference on Machine Learning (ICML-11) (Bellevue), 689–696.

    Not in our library

57. 57.
    Deep learning for neuroimaging: a validation study · 2014

    No notice
58. 58.

    Rathore S. Habes M. Iftikhar M. A. Shacklett A. Davatzikos C. (2017 ). A review on neuroimaging-based classification studies and associated feature extraction methods for Alzheimer's disease and its prodromal stages. NeuroImage 155, 530–548.

    Not in our library10.1016/j.neuroimage.2017.03.057 (opens in a new tab)

59. 59.

    Reas E. (2018 ). ADNI: understanding Alzheimer's disease through collaboration and data sharing. PLoS Blogs Retrieved from: https://blogs.plos.org/neuro/2018/10/24/adni-understanding-alzheimers-disease-through-collaboration-and-data-sharing/ (accessed October 24, 2018).

    Not in our library

60. 60.
    Uncovering Biologically Coherent Peripheral Signatures of Health and Risk for Alzheimer’s Disease in the Aging Brain · 2018

    Not checked
61. 61.

    Ripley B. D. Hjort N. (1996 ). Pattern Recognition and Neural Networks. New York, NY: Cambridge University Press.

    Not in our library

62. 62.

    Rosenblatt F. (1957 ). The Perceptron, A Perceiving and Recognizing Automaton Project Para. Buffalo, NY: Cornell Aeronautical Laboratory.

    Not in our library

63. 63.

    Rosenblatt F. (1958 ). The perceptron: a probabilistic model for information storage and organization in the brain. Psychol. Rev. 65:386.

    Not in our library10.1037/h0042519 (opens in a new tab)

64. 64.

    Rumelhart D. E. Hinton G. E. Williams R. J. (1986 ). Learning representations by back-propagating errors. Nature 323:533

    Not in our library10.1038/323533a0 (opens in a new tab)

65. 65.

    Russakovsky O. Deng J. Su H. Krause J. Satheesh S. Ma S. (2015 ). Imagenet large scale visual recognition challenge. Int. J. Comp. Vision 115, 211–252.

    Not in our library10.1007/s11263-015-0816-y (opens in a new tab)

66. 66.

    Salakhutdinov R. Larochelle H. (2010 ). Efficient learning of deep Boltzmann machines, in Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics (Sardinia), 693–700.

    Not in our library

67. 67.

    Samper-Gonzalez J. Burgos N. Bottani S. Fontanella S. Lu P. Marcoux A.. (2018 ). Reproducible evaluation of classification methods in Alzheimer's disease: framework and application to MRI and PET data. Neuroimage 183, 504–521.

    Not in our library10.1016/j.neuroimage.2018.08.042 (opens in a new tab)

68. 68.

    Schalkoff R. J. (1997 ). Artificial Neural Networks. New York, NY:McGraw-Hill.

    Not in our library

69. 69.

    Schelke M. W. Attia P. Palenchar D. J. Kaplan B. Mureb M. Ganzer C. A.. (2018 ). Mechanisms of risk reduction in the clinical practice of Alzheimer's disease prevention. Front. Aging Neurosci. 10:96.

    Not in our library10.3389/fnagi.2018.00096 (opens in a new tab)

70. 70.

    Schmidhuber J. (2015 ). Deep learning in neural networks: an overview. Neural Netw. 61, 85–117.

    Not in our library10.1016/j.neunet.2014.09.003 (opens in a new tab)

71. 71.

    Smialowski P. Frishman D. Kramer S. (2009 ). Pitfalls of supervised feature selection. Bioinformatics 26, 440–443.

    Not in our library10.1093/bioinformatics/btp621 (opens in a new tab)

72. 72.

    Suk H.-I. Lee S.-W. Shen D. Alzheimer's Disease Neuroimaging Initiative. (2014 ). Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis. NeuroImage 101, 569–582.

    Not in our library10.1016/j.neuroimage.2014.06.077 (opens in a new tab)

73. 73.

    Suk H.-I. Lee S.-W. Shen D. The Alzheimer's Disease Neuroimaging I. (2015 ). Latent feature representation with stacked auto-encoder for AD/MCI diagnosis. Brain Struct. Funct. 220, 841–859.

    Not in our library10.1007/s00429-013-0687-3 (opens in a new tab)

74. 74.

    Suk H.-I. Shen D. (2013 ). Deep learning-based feature representation for AD/MCI classification, in International Conference on Medical Image Computing and Computer-Assisted Intervention, Vol 16 (Nagoya), 583–590.

    Not in our library10.1007/978-3-642-40763-5_72 (opens in a new tab)

75. 75.

    Sutskever I. Martens J. Dahl G. Hinton G. (2013 ). On the importance of initialization and momentum in deep learning, in International Conference on Machine Learning (Atlanta), 1139–1147.

    Not in our library

76. 76.

    Sutton R. S. Barto A. G. (2018 ). Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press.

    Not in our library

77. 77.

    Toga A. W. Bhatt P. Ashish N. (2016 ). Global data sharing in Alzheimer's disease research. Alzheimer Dis. Assoc. Disord. 30:160

    Not in our library10.1097/wad.0000000000000121 (opens in a new tab)

78. 78.

    Vaswani A. Bengio S. Brevdo E. Chollet F. Gomez A. N. Gouws S. (2018 ). Tensor2tensor for neural machine translation, in Proceedings of the 13th Conference of the Association for Machine Translation in the Americas (Boston, MA), 193–199.

    Not in our library

79. 79.

    Veitch D. P. Weiner M. W. Aisen P. S. Beckett L. A. Cairns N. J. Green R. C.. (2019 ). Understanding disease progression and improving Alzheimer's disease clinical trials: recent highlights from the Alzheimer's disease neuroimaging initiative. Alzheimers Dement 15, 106–152.

    Not in our library10.1016/j.jalz.2018.08.005 (opens in a new tab)

80. 80.

    Vincent P. Larochelle H. Bengio Y. Manzagol P. A. (2008 ). Extracting and composing robust features with denoising autoencoders, in Proceedings of the 25th International Conference on Machine Learning (Indianapolis, IN: ACM), 1096–1103.

    Not in our library

81. 81.

    Vincent P. Larochelle H. Lajoie I. Bengio Y. Manzagol P. A. (2010 ). Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion. J. Mach. Learn. Res. 11, 3371–3408.

    Not in our library

82. 82.

    Vu T. D. Yang H.-J. Nguyen V. Q. Oh A. R. Kim M.-S. (2017 ). Multimodal learning using convolution neural network and Sparse Autoencoder, in 2017 IEEE International Conference on Big Data and Smart Computing (BigComp) (Jeju), 309–312.

    Not in our library

83. 83.

    Werbos P. J. (1982 ). Applications of advances in nonlinear sensitivity analysis, in System Modeling and Optimization, eds Drenick R. F. Kozin F (New York, NY: Springer, 762–770.

    Not in our library

84. 84.

    Werbos P. J. (2006 ). Backwards differentiation in AD and neural nets: past links and new opportunities, in Automatic Differentiation: Applications, Theory, and Implementations, eds Bücker H. M. Corliss G. Hovland P. Naumann U. Norris B (New York, NY: Springer, 15–34.

    Not in our library

Cited by papers we hold 7

• A practical Alzheimer’s disease classifier via brain imaging-based deep learning on 85,721 samples · 2022
  Not checked
• Machine learning methods for predicting progression from mild cognitive impairment to Alzheimer’s disease dementia: a systematic review · 2021
  No notice
• Machine Learning and Novel Biomarkers for the Diagnosis of Alzheimer’s Disease · 2021
  No notice
• Application of Machine Learning to Stomatology: A Comprehensive Review · 2020
  Not checked
• Insights into Systemic Disease through Retinal Imaging-Based Oculomics · 2020
  No notice
• Explainable Deep Learning Models in Medical Image Analysis · 2020
  No notice
• Possible Neuroprotective Mechanisms of Physical Exercise in Neurodegeneration · 2020
  No notice

Questions about this paper

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.