RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans

Abstract

Automatic extraction of liver and tumor from CT volumes is a challenging task due to their heterogeneous and diffusive shapes. Recently, 2D deep convolutional neural networks have become popular in medical image segmentation tasks because of the utilization of large labeled datasets to learn hierarchical features. However, few studies investigate 3D networks for liver tumor segmentation. In this paper, we propose a 3D hybrid residual attention-aware segmentation method, i.e., RA-UNet, to precisely extract the liver region and segment tumors from the liver. The proposed network has a basic architecture as U-Net which extracts contextual information combining low-level feature maps with high-level ones. Attention residual modules are integrated so that the attention-aware features change adaptively. This is the first work that an attention residual mechanism is used to segment tumors from 3D medical volumetric images. We evaluated our framework on the public MICCAI 2017 Liver Tumor Segmentation dataset and tested the generalization on the 3DIRCADb dataset. The experiments show that our architecture obtains competitive results.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 59

1. 1.

   Abadi M. Agarwal A. Barham P. Brevdo E. Chen Z. Citro C. (2015 ). TensorFlow: large-scale machine learning on heterogeneous distributed systems. arXiv [Preprint]. arXiv:1603.04467.

   Not in our library

2. 2.

   Alom M. Z. Hasan M. Yakopcic C. Taha T. M. Asari V. K. (2018 ). Recurrent residual convolutional neural network based on U-Net (R2U-Net) for medical image segmentation. arXiv [Preprint]. arXiv:1802.06955. 30944843

   Not in our library10.1109/naecon.2018.8556686

3. 3.

   Andermatt S. Pezold S. Cattin P. (2016 ). Multi-dimensional gated recurrent units for the segmentation of biomedical 3D-data, in Deep Learning and Data Labeling for Medical Applications (Athens: Springer), 142–151.

   Not in our library10.1007/978-3-319-46976-8_15

4. 4.

   Bellver M. Maninis K. Ponttuset J. Nieto X. G. I. Torres J. Van Gool L. (2017 ). Detection-aided liver lesion segmentation using deep learning. arXiv [Preprint]. arXiv:1711.11069.

   Not in our library

5. 5.

   Bi L. Kim J. Kumar A. Feng D. (2017 ). Automatic liver lesion detection using cascaded deep residual networks. arXiv [Preprint]. arXiv:1704.02703.

   Not in our library

6. 6.

   Breiman L. (2001 ). Random forests. Mach. Learn. 45, 5–32.

   Not in our library10.1023/a:1010933404324

7. 7.

   Bui T. D. Shin J. Moon T. (2017 ). 3D densely convolution networks for volumetric segmentation. arXiv [Preprint]. arXiv:1709.03199.

   Not in our library

8. 8.

   Chen L. C. Yang Y. Wang J. Xu W. Yuille A. L. (2016 ). Attention to scale: Scale-aware semantic image segmentation, in IEEE Conference on Computer Vision and Pattern Recognition (Las Vegas, NV), 3640–3649.

   Not in our library10.1109/cvpr.2016.396

9. 9.

   Chollet F. (2015 ). Keras. GitHub.

   Not in our library

10. 10.

    Christ P. F. Ettlinger F. Grun F. Elshaer M. E. A. Lipkova J. Schlecht S. (2017a ). Automatic liver and tumor segmentation of CT and MRI Volumes using cascaded fully convolutional neural networks. arXiv: Computer Vision and Pattern Recognition.

    Not in our library

11. 11.

    Christ P. F. Ettlinger F. Kaissis G. Schlecht S. Ahmaddy F. Grün F. (2017b ). SurvivalNet: Predicting patient survival from diffusion weighted magnetic resonance images using cascaded fully convolutional and 3D convolutional neural networks, in IEEE International Symposium on Biomedical Imaging (ISBI 2017), 839–843.

    Not in our library10.1109/isbi.2017.7950648

12. 12.

    Çiçek Ö. Abdulkadir A. Lienkamp S. S. Brox T. Ronneberger O. (2016 ). 3D U-Net: learning dense volumetric segmentation from sparse annotation, in International Conference on Medical Image Computing and Computer-Assisted Intervention (Athens: Springer), 424–432.

    Not in our library10.1007/978-3-319-46723-8_49

13. 13.

    Collins M. Schapire R. E. Singer Y. (2002 ). Logistic regression, AdaBoost and Bregman distances. Mach. Learn. 48, 253–285.

    Not in our library10.1023/a:1013912006537

14. 14.

    Dolz J. Desrosiers C. Ayed I. B. (2017 ). 3D fully convolutional networks for subcortical segmentation in MRI: a large-scale study. NeuroImage 170, 456–470.

    Not in our library10.1016/j.neuroimage.2017.04.039

15. 15.

    Dou Q. Chen H. Jin Y. Yu L. Qin J. Heng P.-A. (2016 ). 3D deeply supervised network for automatic liver segmentation from CT volumes, in International Conference on Medical Image Computing and Computer-Assisted Intervention (Athens: Springer), 149–157.

    Not in our library10.1007/978-3-319-46723-8_18

16. 16.

    Eapen M. Korah R. Geetha G. (2015 ). Swarm intelligence integrated graph-cut for liver segmentation from 3D-CT Volumes. Sci. World J. 2015:823541.

    Not in our library10.1155/2015/823541

17. 17.

    Furey T. S. Cristianini N. Duffy N. Bednarski D. W. Schummer M. Haussler D. (2000 ). Support vector machine classification and validation of cancer tissue samples using microarray expression data. Bioinformatics 16, 906–914.

    Not in our library10.1093/bioinformatics/16.10.906

18. 18.

    He K. Zhang X. Ren S. Sun J. (2016 ). Deep residual learning for image recognition, in IEEE Conference on Computer Vision and Pattern Recognition (Las Vegas, NV), 770–778.

    Not in our library10.1109/cvpr.2016.90

19. 19.

    Heimann T. Van Ginneken B. Styner M. A. Arzhaeva Y. Aurich V. Bauer C.. (2009 ). Comparison and evaluation of methods for liver segmentation from CT datasets. IEEE Trans. Med. Imag. 28, 1251–1265.

    Not in our library10.1109/tmi.2009.2013851

20. 20.

    Heker M. Greenspan H. (2020 ). Joint liver lesion segmentation and classification via transfer learning. arXiv [Preprint]. arXiv:2004.12352.31946038

    Not in our library

21. 21.

    Hong Q. Shi Z. Sun J. Du S. (2020a ). Memristive self-learning logic circuit with application to encoder and decoder. Neural Comput. Appl. 1–13.

    Not in our library10.1007/s00521-020-05281-z

22. 22.

    Hong Q. Yan R. Wang C. Sun J. (2020b ). Memristive circuit implementation of biological nonassociative learning mechanism and its applications. IEEE Trans. Biomed. Circuits Syst. 14, 1036–1050.

    Not in our library10.1109/tbcas.2020.3018777

23. 23.

    Hossam M. M. Hassanien A. E. Shoman M. (2010 ). 3D brain tumor segmentation scheme using K-mean clustering and connected component labeling algorithms, in International Conference on Intelligent Systems Design and Applications (ISDA) (Cairo: IEEE), 320–324.

    Not in our library10.1109/isda.2010.5687244

24. 24.

    Jin Q. Meng Z. Pham T. D. Chen Q. Wei L. Su R. (2019 ). DUNet: A deformable network for retinal vessel segmentation. Knowl. Based Syst. 178, 149–162.

    Not in our library10.1016/j.knosys.2019.04.025

25. 25.
    RA-UNet: A Hybrid Deep Attention-Aware Network to Extract Liver and Tumor in CT Scans · 2020

    No notice
26. 26.

    Kaluva K. C. Khened M. Kori A. Krishnamurthi G. (2018 ). 2D-densely connected convolution neural networks for automatic liver and tumor segmentation. arXiv [Preprint]. arXiv:1802.02182.

    Not in our library

27. 27.

    Kingma D. P. Ba J. (2014 ). Adam: a method for stochastic optimization. arXiv [Preprint]. arXiv:1412.6980.

    Not in our library

28. 28.

    Lee N. Laine A. F. Klein A. (2011 ). Towards a deep learning approach to brain parcellation, in IEEE International Symposium on Biomedical Imaging: From Nano to Macro (Chicago, IL), 321–324.

    Not in our library10.1109/isbi.2011.5872414

29. 29.

    Li C. Wang X. Eberl S. Fulham M. Yin Y. Chen J.. (2013 ). A likelihood and local constraint level set model for liver tumor segmentation from CT volumes. IEEE Trans. Biomed. Eng. 60, 2967–2977.

    Not in our library10.1109/tbme.2013.2267212

30. 30.

    Li W. Jia F. Hu Q. (2015 ). Automatic segmentation of liver tumor in CT images with deep convolutional neural networks. J. Comput. Commun. 3, 146–151. 31669758

    Not in our library10.4236/jcc.2015.311023

31. 31.

    Li X. Chen H. Qi X. Dou Q. Fu C. -W. Heng P. -A. (2018 ). H-DenseUNet: hybrid densely connected UNet for liver and tumor segmentation from CT volumes. IEEE Trans Med. Imag. 37, 2663–2674.

    Not in our library10.1109/tmi.2018.2845918

32. 32.

    Litjens G. Kooi T. Bejnordi B. E. Setio A. A. A. Ciompi F. Ghafoorian M.. (2017 ). A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60–88.

    Not in our library10.1016/j.media.2017.07.005

33. 33.

    Liu W. Wang Z. Liu X. Zeng N. Liu Y. Alsaadi F. E. (2017 ). A survey of deep neural network architectures and their applications. Neurocomputing 234, 11–26.

    Not in our library10.1016/j.neucom.2016.12.038

34. 34.

    Long J. Shelhamer E. Darrell T. (2015 ). Fully convolutional networks for semantic segmentation, in IEEE Conference on Computer Vision and Pattern Recognition (Boston, MA), 3431–3440.

    Not in our library10.1109/cvpr.2015.7298965

35. 35.

    Lu F. Wu F. Hu P. Peng Z. Kong D. (2017 ). Automatic 3D liver location and segmentation via convolutional neural network and graph cut. Int. J. Comput. Assist. Radiol. Surg. 12, 171–182.

    Not in our library10.1007/s11548-016-1467-3

36. 36.

    Milletari F. Navab N. Ahmadi S. (2016 ). V-Net: fully convolutional neural networks for volumetric medical image segmentation, in International Conference on 3D Vision (Palo Alto, CA), 565–571.

    Not in our library10.1109/3dv.2016.79

37. 37.

    Oktay O. Schlemper J. Folgoc L. L. Lee M. Heinrich M. Misawa K. (2018 ). Attention U-net: learning where to look for the pancreas. arXiv [Preprint]. arXiv:1804.03999.

    Not in our library

38. 38.

    Pandey R. K. Vasan A. Ramakrishnan A. (2018 ). Segmentation of liver lesions with reduced complexity deep models. arXiv [Preprint]. arXiv:1805.09233.

    Not in our library

39. 39.

    Pereira S. Pinto A. Alves V. Silva C. A. (2016 ). Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans. Med. Imag. 35, 1240–1251.

    Not in our library10.1109/tmi.2016.2538465

40. 40.

    Prasoon A. Petersen K. Igel C. Lauze F. Dam E. Nielsen M. (2013 ). Deep feature learning for knee cartilage segmentation using a triplanar convolutional neural network, in International Conference on Medical Image Computing and Computer-Assisted Intervention (Nagoya-shi: Springer), 246–253.

    Not in our library10.1007/978-3-642-40763-5_31

Cited by papers we hold 5

• A novel unified Inception-U-Net hybrid gravitational optimization model (UIGO) incorporating automated medical image segmentation and feature selection for liver tumor detection · 2025
  Not checked
• Three-Dimensional Liver Image Segmentation Using Generative Adversarial Networks Based on Feature Restoration · 2022
  Not checked
• sAMPpred-GAT: prediction of antimicrobial peptide by graph attention network and predicted peptide structure · 2022
  No notice
• A WEBGIS FRAMEWORK FOR SEMI-AUTOMATED GEODATABASE UPDATING ASSISTED BY DEEP LEARNING · 2021
  Not checked
• Deep learning‐based precipitation bias correction approach for Yin–He global spectral model · 2021
  Not checked

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.