To improve in-vivo bio images of fast temporal focusing multiphoton microscopy by multi-stage U-Net image restoration

Yu-Hao Tseng; Yvonne Yuling Hu; Chia-Wei Hsu; Chun-Yu Lin; Hsueh Cheng Chiang; Shean-Jen Chen

doi:10.1117/12.2618266

27 May 2022 To improve in-vivo bio images of fast temporal focusing multiphoton microscopy by multi-stage U-Net image restoration

Yu-Hao Tseng, Yvonne Yuling Hu, Chia-Wei Hsu, Chun-Yu Lin, Hsueh Cheng Chiang, Shean-Jen Chen

Author Affiliations +

Proceedings Volume 12144, Biomedical Spectroscopy, Microscopy, and Imaging II; 121440F (2022) https://doi.org/10.1117/12.2618266
Event: SPIE Photonics Europe, 2022, Strasbourg, France

Abstract

The imaging speed of Temporal focusing multiphoton excitation microscopy (TFMPEM) is up to hundreds frames rate. However, the plane illumination manner suffers from the sever scattering of biotissue and signal crosstalk that blurs the image. And the deeper the worse. Nevertheless, the high acquisition rate decreases the effective excited fluorescent, which reduces the signal-to-noise ratio (SNR) of the image. In order to solve the scattering and low SNR issues, the deep learning method is proposed to restore the TFMPEM image. In this work, we construct a powerful neuron network which called multi-stage 3D U-Net. Different from the cascade method, it becomes more connection between each U-Net. The previous stage information can share with the next stage, instead of seeing as independent. Thus, we try to restore the TFMPEM via this network with Point scanning multiphoton excitation microscopy (PSMPEM) image as the ground truth. But before that way, our two systems are not sharing the same optical path architecture, it needs to do the registration first. For cross modality registration, we utilize Voxelmorph which is also a 3D U-Net architecture. And it can do the not only global but also local deformation, is flexible than classical algorithm. Hence, we do the registration and restoration via all deep learning method. Therefore, the peak signal-to-noise ratio (PSNR) of the image can be improved around 20 to 30 dB and, and structural similarity (SSIM) is close to 0.9

Conference Presentation

Citation Download Citation

Yu-Hao Tseng, Yvonne Yuling Hu, Chia-Wei Hsu, Chun-Yu Lin, Hsueh Cheng Chiang, and Shean-Jen Chen "To improve in-vivo bio images of fast temporal focusing multiphoton microscopy by multi-stage U-Net image restoration", Proc. SPIE 12144, Biomedical Spectroscopy, Microscopy, and Imaging II, 121440F (27 May 2022); https://doi.org/10.1117/12.2618266

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available