Automatic Classification of Cancerous Tissue in Laserendomicroscopy Images of the Oral Cavity using Deep Learning

Abstract

Oral Squamous Cell Carcinoma (OSCC) is a common type of cancer of the oral epithelium. Despite their high impact on mortality, sufficient screening methods for early diagnosis of OSCC often lack accuracy and thus OSCCs are mostly diagnosed at a late stage. Early detection and accurate outline estimation of OSCCs would lead to a better curative outcome and a reduction in recurrence rates after surgical treatment. Confocal Laser Endomicroscopy (CLE) records sub-surface micro-anatomical images for in vivo cell structure analysis. Recent CLE studies showed great prospects for a reliable, real-time ultrastructural imaging of OSCC in situ . We present and evaluate a novel automatic approach for OSCC diagnosis using deep learning technologies on CLE images. The method is compared against textural feature-based machine learning approaches that represent the current state of the art. For this work, CLE image sequences (7894 images) from patients diagnosed with OSCC were obtained from 4 specific locations in the oral cavity, including the OSCC lesion. The present approach is found to outperform the state of the art in CLE image recognition with an area under the curve (AUC) of 0.96 and a mean accuracy of 88.3% (sensitivity 86.6%, specificity 90%).

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 46

1. 1.

   Forastiere A, Koch W, Trotti A, Sidransky D. Head and Neck Cancer. The New England Journal of Medicine. 2001;345:1890-1900.

   Not in our library10.1056/nejmra001375

2. 2.

   Ferlay J, et al. Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012. International Journal of Cancer. 2014;136:E359-E386.

   Not in our library10.1002/ijc.29210

3. 3.

   Muto M, et al. Squamous cell carcinoma in situ at oropharyngeal and hypopharyngeal mucosal sites. Cancer. 2004;101:1375-1381.

   Not in our library10.1002/cncr.20482

4. 4.

   Swinson B, Jerjes W, El-Maaytah M, Norris P, Hopper C. Optical techniques in diagnosis of head and neck malignancy. Oral oncology. 2006;42:221-228.

   Not in our library10.1016/j.oraloncology.2005.05.001

5. 5.

   Knipfer C, et al. Raman difference spectroscopy: a non-invasive method for identification of oral squamous cell carcinoma. Biomedical Optics Express. 2014;5:3252-14.

   Not in our library10.1364/boe.5.003252

6. 6.

   Laemmel E, et al. Fibered confocal fluorescence microscopy (Cell-viZio) facilitates extended imaging in the field of microcirculation. A comparison with intravital microscopy. Journal of vascular research. 2004;41:400-411.

   Not in our library10.1159/000081209

7. 7.

   Neumann H, Kiesslich R, Wallace MB, Neurath MF. Confocal Laser Endomicroscopy: Technical Advances and Clinical Applications. YGAST. 2010;139:388-392.e1-2.

   Not in our library10.1053/j.gastro.2010.06.029

8. 8.

   Hoffman A, et al. Confocal laser endomicroscopy: technical status and current indications. Endoscopy. 2006;38:1275-1283.

   Not in our library10.1055/s-2006-944813

9. 9.

   Oetter N, et al. Development and validation of a classification and scoring system for the diagnosis of oral squamous cell carcinomas through confocal laser endomicroscopy. Journal of Translational Medicine. 2016;14:1-11.

   Not in our library10.1186/s12967-016-0919-4

10. 10.

    Nathan CAO, et al. Confocal Laser Endomicroscopy in the Detection of Head and Neck Precancerous Lesions. Otolaryngology – Head and Neck Surgery. 2014;151:73-80.

    Not in our library10.1177/0194599814528660

11. 11.

    Helmchen F. Miniaturization of fluorescence microscopes using fibre optics. Experimental Physiology. 2002;87.6:737-745.

    Not in our library10.1113/eph8702478

12. 12.

    Minsky M. Memoir on inventing the confocal scanning microscope. Scanning. 1988;10:128-138.

    Not in our library10.1002/sca.4950100403

13. 13.

    Abbaci, M., Breuskin, I., Casiraghi, O. & De Leeuw, F. Confocal laser endomicroscopy for non-invasive head and neck cancer imaging: a comprehensive review. Oral oncology (2014).

    Not in our library10.1016/j.oraloncology.2014.05.002

14. 14.

    Neumann H, Vieth M, Atreya R, Neurath MF, Mudter J. Prospective evaluation of the learning curve of confocal laser endomicroscopy in patients with IBD. Histology and histopathology. 2011;26:867-872.

    Not in our library10.14670/hh-26.867

15. 15.

    Mennone A, Nathanson M. Needle-based confocal laser endomicroscopy to assess liver histology in vivo. Gastrointestinal Endoscopy. 2011;73:338-344.

    Not in our library10.1016/j.gie.2010.10.002

16. 16.

    André B, et al. Software for automated classification of probe-based confocal laser endomicroscopy videos of colorectal polyps. World journal of Gastroenterology. 2012;18:5560-5569.

    Not in our library10.3748/wjg.v18.i39.5560

17. 17.

    Kamen A, et al. Automatic Tissue Differentiation Based on Confocal Endomicroscopic Images for Intraoperative Guidance in Neurosurgery. BioMed Research International. 2016;2016:1-8.

    Not in our library10.1155/2016/6183218

18. 18.

    Veronese, E. et al. Hybrid patch-based and image-wide classification of confocal laser endomicroscopy images in Barrett’s esophagus surveillance. In 2013 IEEE 10th International Symposium on Biomedical Imaging (ISBI 2013), 362–365 (IEEE, 2013).

    Not in our library

19. 19.

    Jaremenko, C. et al. Classification of Confocal Laser Endomicroscopic Images of the Oral Cavity to Distinguish Pathological from Healthy Tissue. In Bildverarbeitung für die Medizin 2015, 479–485 (Springer Berlin Heidelberg, 2015).

    Not in our library

20. 20.

    Dittberner A, et al. Automated analysis of confocal laser endomicroscopy images to detect head and neck cancer. Head & Neck. 2016;38:E1419-E1426.

    Not in our library10.1002/hed.24253

21. 21.

    Rodner, E. et al. Analysis and Classification of Microscopy Images with Cell Border Distance Statistics. In Jahrestagung der Deutschen Gesellschaft für Medizinische Physik DGMP, 1–2 (2015).

    Not in our library

22. 22.

    Hubel DH, Wiesel TN. Receptive fields and functional architecture of monkey striate cortex. The Journal of physiology. 1968;195:215-243.

    Not in our library10.1113/jphysiol.1968.sp008455

23. 23.

    Russakovsky O, Deng J, Su H, Krause J. Imagenet large scale visual recognition challenge. International Journal of Computer Vision. 2015;115:211-252.

    Not in our library10.1007/s11263-015-0816-y

24. 24.
    Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning · 2016

    No notice
25. 25.

    Roth HR, et al. Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation. IEEE Transactions on Medical Imaging. 2016;35:1170-1181.

    Not in our library10.1109/tmi.2015.2482920

26. 26.

    Esteva A, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115-118.

    Not in our library10.1038/nature21056

27. 27.
    Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis · 2016

    No notice
28. 28.

    Würfl, T., Ghesu, F. C., Christlein, V. & Maier, A. Deep Learning Computed Tomography. In Medical Image Computing and Computer-Assisted Intervention – MICCAI 2016, 432–440 (Springer International Publishing, Cham, 2016).

    Not in our library

29. 29.

    Aubreville, M. et al. Correlation-based Alignment of Raw Endoscopic Sequence Data with Physician Selected Movies. Workshop Germany Brazil 2016: Understanding the aggressiveness of cancer cells through novel imaging techniques (2016).

    Not in our library

30. 30.

    Ahonen T, Hadid A, Pietikäinen M. Face Description with Local Binary Patterns: Application to Face Recognition. IEEE transactions on pattern analysis and machine intelligence. 2006;28:2037-2041.

    Not in our library10.1109/tpami.2006.244

31. 31.

    Nanni L, Lumini A, Brahnam S. Local binary patterns variants as texture descriptors for medical image analysis. Artificial intelligence in medicine. 2010;49:117-125.

    Not in our library10.1016/j.artmed.2010.02.006

32. 32.

    Haralick RM, Shanmugam K, Dinstein I. Textural Features for Image Classification. IEEE Transactions on Systems, Man, and Cybernetics. 1973;SMC-3:610-621.

    Not in our library10.1109/tsmc.1973.4309314

33. 33.

    Baraldi A, Parmiggiani F. An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters. IEEE Transactions on Geoscience and Remote Sensing. 1995;33:293-304.

    Not in our library10.1109/36.377929

34. 34.

    Vo, K., Jaremenko, C., Maier, A., Neumann, H. & Bohr, C. Automatic Classification and Pathological Staging of Confocal Laser Endomicroscopic Images of the Vocal Cords. Bildverarbeitung für die Medizin 2017, 312 (Springer Berlin Heidelberg, 2017).

    Not in our library

35. 35.

    Lecun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proceedings of the IEEE. 1998;86:2278-2324.

    Not in our library10.1109/5.726791

36. 36.

    Abadi, M. et al. TensorFlow: A system for large-scale machine learning. ArXiv e-prints (2016).

    Not in our library

37. 37.

    Kingma, D. & Ba, J. Adam: A method for stochastic optimization. ICLR 2015, reprint on arXiv.org (2014).

    Not in our library

38. 38.

    Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the Inception Architecture for Computer Vision. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2818–2826 (IEEE, 2016).

    Not in our library

39. 39.

    Deng, J. et al. ImageNet: A Large-Scale Hierarchical Image Database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2009).

    Not in our library

40. 40.

    Aubreville, M. et al. Patch-based Carcinoma Detection on Confocal Laser Endomicroscopy Images - A Cross-Site Robustness Assessment. ArXiv e-prints (2017).

    Not in our library

Cited by papers we hold 2

• The Transformative Role of Artificial Intelligence in Dentistry: A Comprehensive Overview. Part 1: Fundamentals of AI, and its Contemporary Applications in Dentistry · 2025
  No notice
• Application of Machine Learning to Stomatology: A Comprehensive Review · 2020
  Not checked

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.