Skin Lesion Analysis towards Melanoma Detection Using Deep Learning Network

Abstract

Skin lesions are a severe disease globally. Early detection of melanoma in dermoscopy images significantly increases the survival rate. However, the accurate recognition of melanoma is extremely challenging due to the following reasons: low contrast between lesions and skin, visual similarity between melanoma and non-melanoma lesions, etc. Hence, reliable automatic detection of skin tumors is very useful to increase the accuracy and efficiency of pathologists. In this paper, we proposed two deep learning methods to address three main tasks emerging in the area of skin lesion image processing, i.e., lesion segmentation (task 1), lesion dermoscopic feature extraction (task 2) and lesion classification (task 3). A deep learning framework consisting of two fully convolutional residual networks (FCRN) is proposed to simultaneously produce the segmentation result and the coarse classification result. A lesion index calculation unit (LICU) is developed to refine the coarse classification results by calculating the distance heat-map. A straight-forward CNN is proposed for the dermoscopic feature extraction task. The proposed deep learning frameworks were evaluated on the ISIC 2017 dataset. Experimental results show the promising accuracies of our frameworks, i.e., 0.753 for task 1, 0.848 for task 2 and 0.912 for task 3 were achieved.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 47

1. 1.

   Jerant A.F., Johnson J.T., Sheridan C.D., Caffrey T.J. Early detection and treatment of skin cancer. Am. Fam. Phys. 2000;62:381-382.

   Not in our library

2. 2.

   Binder M., Schwarz M., Winkler A., Steiner A., Kaider A., Wolff K., Pehamberger H. Epiluminescence microscopy. A useful tool for the diagnosis of pigmented skin lesions for formally trained dermatologists. Arch. Dermatol. 1995;131:286-291.

   Not in our library10.1001/archderm.1995.01690150050011

3. 3.

   Celebi M.E., Wen Q., Iyatomi H., Shimizu K., Zhou H., Schaefer G. A state-of-the-art survey on lesion border detection in dermoscopy images. Dermoscopy Image Analysis. 2015.

   Not in our library

4. 4.

   Erkol B., Moss R.H., Stanley R.J., Stoecker W.V., Hvatum E. Automatic lesion boundary detection in dermoscopy images using gradient vector flow snakes. Skin Res. Technol. 2005;11:17-26.

   Not in our library10.1111/j.1600-0846.2005.00092.x

5. 5.

   Celebi M.E., Aslandogan Y.A., Stoecker W.V., Iyatomi H., Oka H., Chen X. Unsupervised border detection in dermoscopy images. Skin Res. Technol. 2007;13.

   Not in our library10.1111/j.1600-0846.2007.00251.x

6. 6.

   Iyatomi H., Oka H., Celebi M.E., Hashimoto M., Hagiwara M., Tanaka M., Ogawa K. An improved Internet-based melanoma screening system with dermatologist-like tumor area extraction algorithm. Comput. Med. Imag. Graph. 2008;32:566-579.

   Not in our library10.1016/j.compmedimag.2008.06.005

7. 7.

   Celebi M.E., Kingravi H.A., Iyatomi H., Aslandogan Y.A., Stoecker W.V., Moss R.H., Malters J.M., Grichnik J.M., Marghoob A.A., Rabinovitz H.S. Border detection in dermoscopy images using statistical region merging. Skin Res. Technol. 2008;14:347.

   Not in our library10.1111/j.1600-0846.2008.00301.x

8. 8.

   Norton K.A., Iyatomi H., Celebi M.E., Ishizaki S., Sawada M., Suzaki R., Kobayashi K., Tanaka M., Ogawa K. Three-phase general border detection method for dermoscopy images using non-uniform illumination correction. Skin Res. Technol. 2012;18:290-300.

   Not in our library10.1111/j.1600-0846.2011.00569.x

9. 9.

   Xie F., Bovik A.C. Automatic segmentation of dermoscopy images using self-generating neural networks seeded by genetic algorithm. Pattern Recognit. 2013;46:1012-1019.

   Not in our library10.1016/j.patcog.2012.08.012

10. 10.

    Sadri A., Zekri M., Sadri S., Gheissari N., Mokhtari M., Kolahdouzan F. Segmentation of dermoscopy images using wavelet networks. IEEE Trans. Biomed. Eng. 2013;60:1134-1141.

    Not in our library10.1109/tbme.2012.2227478

11. 11.

    Celebi M.E., Wen Q., Hwang S., Iyatomi H., Schaefer G. Lesion border detection in dermoscopy images using ensembles of thresholding methods. Skin Res. Technol. 2013;19:e252-e258.

    Not in our library10.1111/j.1600-0846.2012.00636.x

12. 12.

    Peruch F., Bogo F., Bonazza M., Cappelleri V.M., Peserico E. Simpler, faster, more accurate melanocytic lesion segmentation through MEDS. IEEE Trans. Biomed. Eng. 2014;61:557-565.

    Not in our library10.1109/tbme.2013.2283803

13. 13.

    Gómez D.D., Butakoff C., Ersbøll B.K., Stoecker W. Independent histogram pursuit for segmentation of skin lesions. IEEE Trans. Biomed. Eng. 2008;55:157-161.

    Not in our library10.1109/tbme.2007.910651

14. 14.

    Zhou H., Schaefer G., Sadka A., Celebi M.E. Anisotropic mean shift based fuzzy c-means segmentation of skin lesions. IEEE J. Sel. Top. Signal Process. 2009;3:26-34.

    Not in our library10.1109/jstsp.2008.2010631

15. 15.

    Zhou H., Schaefer G., Celebi M.E., Lin F., Liu T. Gradient vector flow with mean shift for skin lesion segmentation. Comput. Med. Imaging Graph. 2011;35:121-127.

    Not in our library10.1016/j.compmedimag.2010.08.002

16. 16.

    Zhou H., Li X., Schaefer G., Celebi M.E., Miller P. Mean shift based gradient vector flow for image segmentation. Comput. Vis. Image Underst. 2013;117:1004-1016.

    Not in our library10.1016/j.cviu.2012.11.015

17. 17.

    Garnavi R., Aldeen M., Celebi M.E., Varigos G., Finch S. Border detection in dermoscopy images using hybrid thresholding on optimized color channels. Comput. Med. Imaging Graph. 2011;35:105-115.

    Not in our library10.1016/j.compmedimag.2010.08.001

18. 18.

    Pennisi A., Bloisi D.D., Nardi D., Giampetruzzi A.R., Mondino C., Facchiano A. Skin lesion image segmentation using delaunay triangulation for melanoma detection. Comput. Med. Imaging Graph. 2016;52:89-103.

    Not in our library10.1016/j.compmedimag.2016.05.002

19. 19.

    Ma Z., Tavares J. A novel approach to segment skin lesions in dermoscopic images based on a deformable model. IEEE J. Biomed. Health Inform. 2017;20:615-623.

    Not in our library10.1109/jbhi.2015.2390032

20. 20.

    Yu L., Chen H., Dou Q., Qin J., Heng P.A. Automated melanoma recognition in dermoscopy images via very deep residual networks. IEEE Trans. Med. Imaging. 2017;36:994-1004.

    Not in our library10.1109/tmi.2016.2642839

21. 21.

    Celebi M.E., Kingravi H.A., Uddin B., Iyatomi H., Aslandogan Y.A., Stoecker W.V., Moss R.H. A methodological approach to the classification of dermoscopy images. Comput. Med. Imaging Graph. 2007;31:362-373.

    Not in our library10.1016/j.compmedimag.2007.01.003

22. 22.

    Celebi M.E., Iyatomi H., Schaefer G., Stoecker W.V. Lesion border detection in dermoscopy images. Comput. Med. Imaging Graph. 2009;33:148-153.

    Not in our library10.1016/j.compmedimag.2008.11.002

23. 23.

    Schaefer G., Krawczyk B., Celebi M.E., Iyatomi H. An ensemble classification approach for melanoma diagnosis. Memet. Comput. 2014;6:233-240.

    Not in our library10.1007/s12293-014-0144-8

24. 24.

    Stanley R.J., Stoecker W.V., Moss R.H. A relative color approach to color discrimination for malignant melanoma detection in dermoscopy images. Skin Res. Technol. 2007;13:62-72.

    Not in our library10.1111/j.1600-0846.2007.00192.x

25. 25.

    Hospedales T., Romero A., Vázquez D. Guest editorial: Deep learning in computer vision. IET Comput. Vis. 2017;11:621-622.

    Not in our library

26. 26.

    Sulistyo S.B., Woo W.L., Dlay S.S. Regularized neural networks fusion and genetic algorithm based on-field nitrogen status estimation of wheat plants. IEEE Trans. Ind. Inform. 2017;13:103-114.

    Not in our library10.1109/tii.2016.2628439

27. 27.

    Sulistyo S.B., Wu D., Woo W.L., Dlay S.S., Gao B., Member S. Computational deep intelligence vision sensing for nutrient content estimation in agricultural automation. IEEE Trans. Autom. Sci. Eng. 2017.

    Not in our library10.1109/tase.2017.2770170

28. 28.

    Sulistyo S., Woo W.L., Dlay S., Gao B. Building a globally optimized computational intelligent image processing algorithm for on-site nitrogen status analysis in plants. IEEE Intell. Syst. 2018.

    Not in our library10.1109/mis.2018.111144506

29. 29.

    Codella N., Cai J., Abedini M., Garnavi R., Halpern A., Smith J.R. Deep learning, sparse coding, and svm for melanoma recognition in dermoscopy images. International Workshop on Machine Learning in Medical Imaging. 2015;118-126.

    Not in our library

30. 30.

    Codella N., Nguyen Q.B., Pankanti S., Gutman D., Helba B., Halpern A., Smith J.R. Deep learning ensembles for melanoma recognition in dermoscopy images. IBM J. Res. Dev. 2016;61.

    Not in our library10.1147/jrd.2017.2708299

31. 31.

    Kawahara J., Bentaieb A., Hamarneh G. Deep features to classify skin lesions. Proceedings of the 2016 IEEE 13th International Symposium onpp. Biomedical Imaging (ISBI). 1397-1400.

    Not in our library

32. 32.

    Li Y., Shen L., Yu S. HEp-2 specimen image segmentation and classification using very deep fully convolutional network. IEEE Trans. Med. Imaging. 2017;36:1561-1572.

    Not in our library10.1109/tmi.2017.2672702

33. 33.

    He K., Zhang X., Ren S., Sun J. Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770-778.

    Not in our library

34. 34.

    Vedaldi A., Lenc K. MatConvNet—Convolutional neural networks for MATLAB. Proceedings of the ACM International Conference on Multimedia. 689-692.

    Not in our library

35. 35.

    Achanta R., Shaji A., Smith K., Lucchi A., Fua P., SüSstrunk S. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 2012;34:2274-2282.

    Not in our library10.1109/tpami.2012.120

36. 36.

    Lin M., Chen Q., Yan S. Network in network. arXiv. 2013.

    Not in our library

37. 37.

    Lecun Y., Boser B., Denker J.S., Henderson D., Howard R.E., Hubbard W., Jackel L.D. Backpropagation applied to handwritten zip code recognition. Neural Comput. 1989;1:541-551.

    Not in our library10.1162/neco.1989.1.4.541

38. 38.

    Codella N.C.F., Gutman D., Celebi E., Helba B., Marchetti A.M., Dusza W.S., Kalloo A., Liopyris K., Mishra N., Kittler H., et al. Skin lesion analysis toward melanoma detection: A challenge at the 2017 international symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC). arXiv. 2017.

    Not in our library

39. 39.

    Ioffe S., Szegedy C. Batch Normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the 32nd International Conference on Machine Learning. 448-456.

    Not in our library

40. 40.

    Szegedy C., Vanhoucke V., Ioffe S., Shlens J., Wojna Z. Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2818-2826.

    Not in our library

41. 41.

    Shelhamer E., Long J., Darrell T. Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3431-3440.

    Not in our library

42. 42.

    Ronneberger O., Fischer P., Brox T. U-Net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer Assisted Interventions. 234-241.

    Not in our library

43. 43.

    Wen H. II-FCN for skin lesion analysis towards melanoma detection. arXiv. 2017.

    Not in our library

44. 44.

    Attia M., Hossny M., Nahavandi S., Yazdabadi A. Spatially aware melanoma segmentation using hybrid deep learning techniques. arXiv. 2017.

    Not in our library

45. 45.

    Kawahara J., Hamarneh G. Fully convolutional networks to detect clinical dermoscopic features. arXiv. 2017.

    Not in our library10.1109/jbhi.2018.2831680

46. 46.

    Krizhevsky A., Sutskever I., Hinton G.E. ImageNet classification with deep convolutional neural networks. Proceedings of the International Conference on Neural Information Processing Systems. 1097-1105.

    Not in our library

47. 47.

    Simonyan K., Zisserman A. Very deep convolutional networks for large-scale image recognition. arXiv. 2015.

    Not in our library

Cited by papers we hold 2

• Deep Learning-Based System for Automatic Melanoma Detection · 2020
  Not checked
• Artificial intelligence detection of distal radius fractures: a comparison between the convolutional neural network and professional assessments · 2019
  No notice

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.