Deep learning for biomedical photoacoustic imaging: A review

Abstract

Photoacoustic imaging (PAI) is a promising emerging imaging modality that enables spatially resolved imaging of optical tissue properties up to several centimeters deep in tissue, creating the potential for numerous exciting clinical applications. However, extraction of relevant tissue parameters from the raw data requires the solving of inverse image reconstruction problems, which have proven extremely difficult to solve. The application of deep learning methods has recently exploded in popularity, leading to impressive successes in the context of medical imaging and also finding first use in the field of PAI. Deep learning methods possess unique advantages that can facilitate the clinical translation of PAI, such as extremely fast computation times and the fact that they can be adapted to any given problem. In this review, we examine the current state of the art regarding deep learning in PAI and identify potential directions of research that will help to reach the goal of clinical applicability.

Full text

Its licence does not allow us to show the full text. Read it at PubMed Central:

References 188

1. 1.

   Wang L.V., Gao L. Photoacoustic microscopy and computed tomography: from bench to bedside. Annu. Rev. Biomed. Eng. 2014;16:155-185.

   Not in our library10.1146/annurev-bioeng-071813-104553

2. 2.

   Kim C., Erpelding T.N., Jankovic L. Deeply penetrating in vivo photoacoustic imaging using a clinical ultrasound array system. Biomed. Opt. Express. 2010;1(1):278-284.

   Not in our library10.1364/boe.1.000278

3. 3.

   Mallidi S., Luke G.P., Emelianov S. Photoacoustic imaging in cancer detection, diagnosis, and treatment guidance. Trends Biotechnol. 2011;29(5):213-221.

   Not in our library10.1016/j.tibtech.2011.01.006

4. 4.

   Beard P. Biomedical photoacoustic imaging. Interface Focus. 2011;1(4):602-631.

   Not in our library10.1098/rsfs.2011.0028

5. 5.

   Rosencwaig A., Gersho A. Theory of the photoacoustic effect with solids. J. Appl. Phys. 1976;47(1):64-69.

   Not in our library

6. 6.

   Li H., Zhuang S., Li D.-a. Benign and malignant classification of mammogram images based on deep learning. Biomed. Signal Process. Control. 2019;51:347-354.

   Not in our library

7. 7.

   Zhang J., Chen B., Zhou M. Photoacoustic image classification and segmentation of breast cancer: a feasibility study. IEEE Access. 2018;7:5457-5466.

   Not in our library

8. 8.

   Quiros-Gonzalez I., Tomaszewski M.R., Aitken S.J. Optoacoustics delineates murine breast cancer models displaying angiogenesis and vascular mimicry. Br. J. Cancer. 2018;118(8):1098.

   Not in our library10.1038/s41416-018-0033-x

9. 9.

   Oh J.-T., Li M.-L., Zhang H.F. Three-dimensional imaging of skin melanoma in vivo by dual-wavelength photoacoustic microscopy. J. Biomed. Opt. 2006;11(3):034032.

   Not in our library10.1117/1.2210907

10. 10.

    Weight R.M., Viator J.A., Dale P.S. Photoacoustic detection of metastatic melanoma cells in the human circulatory system. Opt. Lett. 2006;31(20):2998-3000.

    Not in our library10.1364/ol.31.002998

11. 11.

    Zhang C., Maslov K., Wang L.V. Subwavelength-resolution label-free photoacoustic microscopy of optical absorption in vivo. Opt. Lett. 2010;35(19):3195-3197.

    Not in our library10.1364/ol.35.003195

12. 12.

    Zhang Y., Cai X., Choi S.-W. Chronic label-free volumetric photoacoustic microscopy of melanoma cells in three-dimensional porous scaffolds. Biomaterials. 2010;31(33):8651-8658.

    Not in our library10.1016/j.biomaterials.2010.07.089

13. 13.

    Song K.H., Stein E.W., Margenthaler J.A. Noninvasive photoacoustic identification of sentinel lymph nodes containing methylene blue in vivo in a rat model. J. Biomed. Opt. 2008;13(5):054033.

    Not in our library10.1117/1.2976427

14. 14.

    Erpelding T.N., Kim C., Pramanik M. Sentinel lymph nodes in the rat: noninvasive photoacoustic and us imaging with a clinical us system. Radiology. 2010;256(1):102-110.

    Not in our library10.1148/radiol.10091772

15. 15.
    Dual-Modality Photoacoustic and Ultrasound Imaging System for Noninvasive Sentinel Lymph Node Detection in Patients with Breast Cancer · 2015

    No notice
16. 16.

    Hanahan D., Weinberg R.A. Hallmarks of cancer: the next generation. Cell. 2011;144(5):646-674.

    Not in our library10.1016/j.cell.2011.02.013

17. 17.

    Wang L.V., Wu H.-i. Biomedical Optics: Principles and Imaging. 2012.

    Not in our library

18. 18.

    Wang X., Chamberland D.L., Jamadar D.A. Noninvasive photoacoustic tomography of human peripheral joints toward diagnosis of inflammatory arthritis. Opt. Lett. 2007;32(20):3002-3004.

    Not in our library10.1364/ol.32.003002

19. 19.

    Rajian J.R., Girish G., Wang X. Photoacoustic tomography to identify inflammatory arthritis. J. Biomed. Opt. 2012;17(9):096013.

    Not in our library10.1117/1.jbo.17.9.096013

20. 20.

    Jo J., Xu G., Zhu Y. Detecting joint inflammation by an led-based photoacoustic imaging system: a feasibility study. J. Biomed. Opt. 2018;23(11):110501.

    Not in our library10.1117/1.jbo.23.11.110501

21. 21.

    Knieling F., Neufert C., Hartmann A. Multispectral optoacoustic tomography for assessment of Crohn’s disease activity. N. Engl. J. Med. 2017;376(13):1292.

    Not in our library10.1056/nejmc1612455

22. 22.

    Waldner M.J., Knieling F., Egger C. Multispectral optoacoustic tomography in Crohn’s disease: noninvasive imaging of disease activity. Gastroenterology. 2016;151(2):238-240.

    Not in our library10.1053/j.gastro.2016.05.047

23. 23.

    Lei H., Johnson L.A., Eaton K.A. Characterizing intestinal strictures of Crohn’s disease in vivo by endoscopic photoacoustic imaging. Biomed. Opt. Express. 2019;10(5):2542-2555.

    Not in our library10.1364/boe.10.002542

24. 24.

    Niederhauser J.J., Jaeger M., Lemor R. Combined ultrasound and optoacoustic system for real-time high-contrast vascular imaging in vivo. IEEE Trans. Med. Imaging. 2005;24(4):436-440.

    Not in our library10.1109/tmi.2004.843199

25. 25.

    Aguirre A., Ardeshirpour Y., Sanders M.M. Potential role of coregistered photoacoustic and ultrasound imaging in ovarian cancer detection and characterization. Transl. Oncol. 2011;4(1):29.

    Not in our library10.1593/tlo.10187

26. 26.

    Needles A., Heinmiller A., Sun J. Development and initial application of a fully integrated photoacoustic micro-ultrasound system. IEEE Trans. Ultrason. Ferroelectr. Freq. Control. 2013;60(5):888-897.

    Not in our library10.1109/tuffc.2013.2646

27. 27.

    Elbau P., Mindrinos L., Scherzer O. Quantitative reconstructions in multi-modal photoacoustic and optical coherence tomography imaging. Inverse Probl. 2017;34(1):014006.

    Not in our library

28. 28.

    Mandal S., Mueller M., Komljenovic D. Multimodal priors reduce acoustic and optical inaccuracies in photoacoustic imaging. Photons Plus Ultrasound: Imaging and Sensing 2019, vol. 10878. 2019;108781M.

    Not in our library

29. 29.

    Wang X., Pang Y., Ku G. Noninvasive laser-induced photoacoustic tomography for structural and functional in vivo imaging of the brain. Nat. Biotechnol. 2003;21(7):803.

    Not in our library10.1038/nbt839

30. 30.

    Ku G., Wang X., Xie X. Imaging of tumor angiogenesis in rat brains in vivo by photoacoustic tomography. Appl. Opt. 2005;44(5):770-775.

    Not in our library10.1364/ao.44.000770

31. 31.

    Hu S., Maslov K.I., Tsytsarev V. Functional transcranial brain imaging by optical-resolution photoacoustic microscopy. J. Biomed. Opt. 2009;14(4):040503.

    Not in our library10.1117/1.3194136

32. 32.

    Yao J., Wang L.V. Photoacoustic brain imaging: from microscopic to macroscopic scales. Neurophotonics. 2014;1(1):011003.

    Not in our library10.1117/1.nph.1.1.011003

33. 33.

    Mohammadi L., Manwar R., Behnam H. Skull’s aberration modeling: towards photoacoustic human brain imaging. Photons Plus Ultrasound: Imaging and Sensing 2019, vol. 10878. 2019;108785W.

    Not in our library

34. 34.

    Kim C., Erpelding T.N., Maslov K.I. Handheld array-based photoacoustic probe for guiding needle biopsy of sentinel lymph nodes. J. Biomed. Opt. 2010;15(4):046010.

    Not in our library10.1117/1.3469829

35. 35.

    Su J.L., Karpiouk A.B., Wang B. Photoacoustic imaging of clinical metal needles in tissue. J. Biomed. Opt. 2010;15(2):021309.

    Not in our library10.1117/1.3368686

36. 36.

    Upputuri P.K., Pramanik M. Recent advances toward preclinical and clinical translation of photoacoustic tomography: a review. J. Biomed. Opt. 2016;22(4):041006.

    Not in our library10.1117/1.jbo.22.4.041006

37. 37.

    Xu M., Wang L.V. Universal back-projection algorithm for photoacoustic computed tomography. Phys. Rev. E. 2005;71(1):016706.

    Not in our library10.1103/physreve.71.016706

38. 38.

    Mozaffarzadeh M., Mahloojifar A., Orooji M. Double-stage delay multiply and sum beamforming algorithm: application to linear-array photoacoustic imaging. IEEE Trans. Biomed. Eng. 2017;65(1):31-42.

    Not in our library10.1109/tbme.2017.2690959

39. 39.

    Treeby B.E., Cox B.T. k-wave: Matlab toolbox for the simulation and reconstruction of photoacoustic wave fields. J. Biomed. Opt. 2010;15(2):021314.

    Not in our library10.1117/1.3360308

40. 40.

    Huang C., Wang K., Nie L. Full-wave iterative image reconstruction in photoacoustic tomography with acoustically inhomogeneous media. IEEE Trans. Med. Imaging. 2013;32(6):1097-1110.

    Not in our library10.1109/tmi.2013.2254496

Reads

A person counts once a day per paper. We keep no cookie and no address: a reader is a hash that changes every day. Any month under five reads shows no number.