We propose a nonscanning three-dimensional (3-D) fluorescence imaging technique using the transport of intensity equation (TIE) and free-space Fresnel propagation. In this imaging technique, a phase distribution corresponding to defocused fluorescence images with a point-light-source-like shape is retrieved by a TIE-based phase retrieval algorithm. From the obtained phase distribution, and its corresponding amplitude distribution, of the defocused fluorescence image, various images at different distances can be reconstructed at the desired plane after Fresnel propagation of the complex wave function. Through the proposed imaging approach, the 3-D fluorescence imaging can be performed in multiple planes. The fluorescence intensity images are captured with the help of an electrically tunable lens; hence, the imaging technique is free from motion artifacts. We present experimental results corresponding to microbeads and a biological sample to demonstrate the proposed 3-D fluorescence imaging technique.
Fluorescence imaging is an important technique to get the functional information of a biological sample for cellular and microbiological investigations, as has been proved by several studies.1–13 Most of the reported fluorescence imaging techniques are either two-dimensional in nature or involve sectioning to get three-dimensional (3-D) information, such as laser scanning confocal microscopy and other related techniques.1–11 These techniques are time-consuming processes to obtain the 3-D information of objects. Further techniques have been developed by using digital holography in fluorescence microscopy to record and retrieve the 3-D information of a fluorescent object.12,13 However, by adopting digital holography or other interferometric systems for 3-D fluorescence imaging, the imaging systems become more complicated due to the involvement of an additional reference beam. So, it is desirable to further investigate 3-D fluorescence imaging techniques to develop simple, compact, and cost-effective solutions.
Noninterferometric imaging techniques, such as those based on the transport of intensity equation (TIE), have been proposed for quantitative phase imaging,14–22 which does not require a reference beam and hence makes the system simple and compact. Teague proposed the TIE from the Helmholtz equation under the paraxial approximation with the assumption of a monochromatic and coherent beam.14 Some reported variants of the TIE method work with partial coherence illumination.15–20 Hence, the TIE technique has an additional advantage of robustness against disturbance under the partially coherent illumination, which extends its application to microscopy.17–22 In these techniques, it is often inevitable or desirable that the field should be partially coherent. Generally, the TIE method requires two or three intensity measurements recorded at different planes to retrieve the phase distribution. In addition to simple optical phase microscopy, it has been demonstrated that accurate and high-quality quantitative phase imaging can be achieved by imaging techniques based on TIE with partially coherent illuminations to prevent image degradation due to speckle noise.15–20 Focus estimation has also been proposed in TIE phase imaging using inverse Fresnel propagation.21,22 To apply this concept in fluorescence imaging could be advantageous in different applications requiring 3-D fluorescence imaging.
Here, we propose the use of the TIE for the 3-D fluorescence imaging. With the help of a TIE-based phase retrieval algorithm and Fresnel backpropagation, images focused at different distances can be obtained from three defocused fluorescent images recorded in multiple planes. To the best of our knowledge, this is the first paper to demonstrate 3-D fluorescence imaging of biological samples by TIE. Although fluorescence light is incoherent, the partial spatial coherence of defocused images obtained by propagation is available when specific conditions, such as small fluorescence light sources (from nuclei of the cells) and narrow bandwidth, are assumed. Note that the phase distribution is measured in the image defocused plane, not in the object plane where the nuclei of the cells exist. The proposed imaging system is simple and straightforward and can be used for different kinds of fluorescent samples. The idea is demonstrated experimentally by developing a specific 3-D microscopy optical setup.
The optical setup of the proposed 3-D fluorescence imaging system is shown in Fig. 1. In this system, a blue LED light source was used to excite the sample placed on the stage. Three defocus intensity images were recorded by changing the optical power of the commercially available electrically tunable lens (ETL), EL-16-40-TC from Optotune, to solve the TIE for obtaining the phase distributions at the output plane. The ETL is inserted at the Fourier plane of the first lens. In this setup, the magnification ratio is fixed even when the object is located at different depth positions. The ETL is basically a variable focal length lens8,10 that is used to implement nonmovable TIE.17 After solving TIE by using these images, the phase distribution can be retrieved.16–22
It is well known that the light emitted by a fluorescence sample is not coherent. However, in the applications of biological samples, fluorescence proteins are stained to the cells, and then the fluorescence distribution of nucleus is assumed as a quasi-point-like monochromatic source, because its size is about . Besides, in our optical system, a band-pass filter with a central wavelength of 575 nm and width of 10 nm is used to increase the temporal coherence. Therefore, partial spatial coherence of the fluorescence light can be considered after propagation through the optical system even if there is no coded aperture.13 For the partial coherence field, the generalized definition of TIE for phase has been discussed in Refs. 15 and 16 and it has been demonstrated in several studies to obtain phase distributions.17–19 In case of partial coherence field, the TIE can be derived from the Helmholtz equation, which is explained as follows:16–22 Here, we consider the intensity distribution, , and defocus intensity distributions can be captured, which are to be located at axial positions and , respectively. The obtained phase can be determined by the following equation:
In the previous equation, and are the spatial frequencies corresponding to and coordinates, respectively. The intensity derivative used in Eq. (2) is calculated approximately by using the difference between the two intensity distributions obtained at depth positions and , as is shown in the following equation:
Now the complex amplitude, , is obtained by multiplying the square root of the intensity image, , with the retrieved phase, , and this complex amplitude is Fresnel propagated. From the back- or forward-propagated distribution, intensity images of the fluorescent samples can be estimated at multiple planes located at different distances.21,22
Experiments and Results
Various experiments were performed to verify the proposed method for 3-D fluorescence imaging using the optical setup shown in Fig. 1. Microscope objective of magnification was used for imaging fluorescent microbeads and a biological sample. In the first experiment, single plane fluorescence imaging of microbeads of diameter is verified and the focusing capability is demonstrated. A blue LED of 470-nm wavelength was used as an excitation light source for the microbeads. The fluorescent microbeads emit light with a wavelength ranging from 550 to 600 nm. A bandpass filter centered at 575 nm with a bandwidth of 10 nm was used in front of the image sensor. The effective pixel number of the image sensor is with a pixel pitch of .
Results of single plane fluorescence imaging are shown in Fig. 2. Three defocus intensity images of fluorescent microbeads were recorded, as shown in Figs. 2(a)–2(c), by changing the focal length of the ETL. A focus intensity image of the input plane was also recorded to compare it with the retrieved focused fluorescent image obtained with the proposed method. The defocus distances of the three recorded images from the ideal focus image are 20, 30, and , respectively. From these images, the phase image corresponding to the intensity image shown in Fig. 2(b) was retrieved by solving the TIE. The result is shown in Fig. 2(d). Here, the image shown in Fig. 2(b) is treated as the intensity distribution , as used in Eqs. (2) and (3), and the images shown in Figs. 2(a) and 2(c) are considered as and , respectively, for solving the TIE. Figure 2(e) shows the surface plot of the retrieved phase. The focus image, shown in Fig. 2(f), was recovered after backpropagation of the complex function calculated from the amplitude image, shown in Fig. 2(b), and the corresponding retrieved phase. The original focus image recorded in the experiment is shown in Fig. 2(g). Figure 2(h) shows the line plot across the image of the bead on the recovered and the original focus images. Here, the reconstruction distance from central defocus image is 24 mm. From these results, it can be seen that the focus image can be obtained successfully from the three defocus images, which proves the capability of our method to provide 3-D fluorescence imaging.
Another experiment was performed to demonstrate the 3-D fluorescence imaging capability of the proposed method. For this experiment, two layers of fluorescent beads were prepared on glass slides with a separation of more than and again, three defocus images were recorded, as shown in Figs. 3(a)–3(c). In this case, defocus images were recorded in between with an interval of . The phase image shown in Fig. 3(d) corresponds to the phase associated with the intensity image in Fig. 3(b). This image in Fig. 3(b) is considered as ; the images shown in Figs. 3(a) and 3(c), as and , respectively. Figure 3(e) shows the surface plot of the phase distribution in Fig. 3(d). Figure 3(e) indicates that the defocused image to obtain the complex amplitude distribution is located at a farther position than that of Fig. 2(e). The maximum phase amount depends on the distance from the observed defocused plane to the focused plane to be reconstructed. The effect of two beads located at different distances is clearly noticeable. The complex light field is determined from the retrieved phase and its corresponding intensity image. Images focused at different planes, showing clear intensity images of the beads, were recovered by Fresnel propagation of the complex function. These recovered focus images are shown in Figs. 3(f) and 3(g). The corresponding original images, with beads in focus, recorded experimentally by conventional imaging, are shown in Figs. 3(h) and 3(i). Reconstruction distance from the central defocus image for the upper bead is 45 mm to positive side and 36 mm for other beads to the negative side from the measurement plane. Figures 3(j) and 3(k) show line plot across the images of beads of the recovered and original intensity distributions in both planes. From these results, it can be confirmed that the 3-D fluorescence imaging can be performed by our proposed method.
In the third experiment, the 3-D imaging capability of the proposed method was verified on a biological sample. GCaMP-expressing neurons in a cerebral slice of thickness from a CaMK2-CreERT2/Rosa-GCaMP323 mouse treated with tamoxifen were visualized by anti-GFP immunostaining with Cy3-tyramine signal amplification system. For this sample, a green LED of the central wavelength of 575 nm was used as the light source to excite the fluorescent-labeled neurite and cells. The fluorescent-labeled neurite and cells emit light with a wavelength ranging from 620 to 640 nm, thus a bandpass filter centered at 630 nm was used in front of the image sensor. The three experimentally recorded defocus images of the biological sample are shown in Figs. 4(a)–4(c). Fluorescent light from neurite can be clearly seen. These defocus images were recorded with an interval of . Here, the sample is shifted along the depth direction by a translation stage to obtain the defocused images instead of ETL. The retrieved phase obtained by TIE algorithm corresponding to the intensity images in Figs. 4(a)–4(c) is shown in Fig. 4(d). The surface plot of the phase is shown in Fig. 4(e). From the complex field retrieved from the phase in Fig. 4(d) and intensity in Fig. 4(b), reconstructed images in the image plane at different depths of 22, 26, and 30 mm can be recovered, which are shown in Figs. 4(f)–4(h), respectively. From these results, it can be concluded that with our proposed technique, it is possible to perform 3-D fluorescence imaging of biological sample in multiple planes from defocused intensity images.
In this work, we have presented a scanless 3-D fluorescence imaging scheme based on the TIE technique that uses the Fresnel backpropagation of a complex wave function calculated from the phase retrieved by TIE and its corresponding intensity image. In the proposed imaging technique, the phase distribution corresponding to defocus fluorescence images is retrieved by a phase retrieval algorithm based on TIE. Images focused at different planes can be estimated from the complex distribution after the numerical calculation of inverse Fresnel propagation. Through the proposed imaging approach, it is straightforward to perform 3-D fluorescence imaging in multiple planes. Real-time imaging, for example, for live-cell imaging will be also possible because intensity fluorescence images can be captured with the help of fast ETLs and focus images are retrieved by fast FT-based numerical methods. The feasibility of the proposed 3-D fluorescence imaging method is demonstrated by experimental results obtained from distributions of microbeads and a biological sample.
O. M, S. K. R., and M. K. acknowledge financial support from Grants-in-Aids for Scientific Research from the Ministry of Education, Culture, Sports, Science, and Technology in Japan; Award No. 17F17369, 18H03888, and 17F17370, and Japan Science and Technology Agency; Award No. JPMJCR1755. This study was partly supported by a CREST grant from AMED (JP18gm0910012 to T.F.) and Grants-in-Aids for Scientific Research from the Ministry of Education, Culture, Sports, Science, and Technology in Japan (18H05429 to T.F.) E. T. acknowledges financial support from Generalitat Valenciana (PROMETEO/2016/079) and Ministerio de Economía y Competitividad, MINECO (FIS2016-75618-R).
Sudheesh K. Rajput is a JSPS postdoctoral research fellow at Kobe University, Japan. He received his BS and MS degrees in physics in 2006 and 2008, respectively, from Chhatrapati Shahu Ji Maharaj University, in Kanpur, India, and his PhD in optics in 2015 from the Indian Institute of Technology, Patna, India. His research interests include optical security, optical sound-field imaging, digital holography and transport of intensity equation imaging, and multimodal systems for fluorescence and phase imaging.
Manoj Kumar received his MTech degree in instrumentation from the National Institute of Technology Kurukshetra, in 2011 and his PhD in optical engineering from the Indian Institute of Technology Delhi, New Delhi, in 2016. Presently, he is a JSPS postdoctoral research fellow at Kobe University, Japan. His research interests include 3D imaging, biomedical optics, digital holography, speckle metrology, and optical instrumentation. He is a member of the Optical Society of America (OSA).
Xiangyu Quan is an assistant professor in the Department of System Informatics at Kobe University, Japan. She received her BS degree from Beijing Information Science and Technology University in China, and received her ME and DE degrees from Kobe University, in 2015 and 2017, respectively. Her research interests include quantitative phase imaging microscopy, 3D fluorescence microscopy and optogenetic light stimulations tools by digital holographic methods. She is a member of OSA and SPIE.
Mitsuhiro Morita is an associate professor at the Graduate School of Sciences, Kobe University. He received his PhD in biology from Kobe University. His research interests include neuroscience, focusing on pathophysiological functions of glial cells, and bioimaging, especially calcium imaging. He is a member of the Japanese Neuroscience Society.
Tomoyuki Furuyashiki is a professor and the chair of the Division of Pharmacology, Graduate School of Medicine, Kobe University, Japan. He obtained his PhD in 2001 from Kyoto University, Japan. His current research interest is to understand molecular, cellular, and neural-circuitry mechanisms underlying stress-induced mental and bodily changes and to translate the findings to stress-related disorders, such as depressions, in clinics.
Yasuhiro Awatsuji received his BE, ME and DE degrees from Osaka University, in 1992, 1994 and 1997, respectively. He was a research associate from 1997 to 2005, and an associate professor from 2005 to 2014 at Kyoto Institute of Technology (KIT). He has been a professor at KIT since 2014. His research interests are in the area of information optics with emphasis on holography. He is a senior member of SPIE and OSA.
Enrique Tajahuerce is an associate professor in the Department of Physics at Universitat Jaume I, Castelló, Spain. He develops his research at the Institute of New Imaging Technologies (INIT) in the same university. He received his PhD in physics from Universidad de Valencia, Spain, in 1998. His research interests include diffractive optics, adaptive optics, digital holography, computational imaging, imaging through scattering media, and single-pixel imaging. He is a senior member of SPIE.
Osamu Matoba is a professor at the Graduate School of Systems Science, Kobe University. He received his PhD in applied physics from Osaka University. His research interests include multimodal 3D imaging using digital holography, transport of intensity equation, light field and optical sound field imaging, imaging through scattering tissue, and 3D display. He is a fellow of OSA and SPIE.