Translator Disclaimer
12 November 2019 Three-dimensional fluorescence imaging using the transport of intensity equation
Author Affiliations +
Abstract

We propose a nonscanning three-dimensional (3-D) fluorescence imaging technique using the transport of intensity equation (TIE) and free-space Fresnel propagation. In this imaging technique, a phase distribution corresponding to defocused fluorescence images with a point-light-source-like shape is retrieved by a TIE-based phase retrieval algorithm. From the obtained phase distribution, and its corresponding amplitude distribution, of the defocused fluorescence image, various images at different distances can be reconstructed at the desired plane after Fresnel propagation of the complex wave function. Through the proposed imaging approach, the 3-D fluorescence imaging can be performed in multiple planes. The fluorescence intensity images are captured with the help of an electrically tunable lens; hence, the imaging technique is free from motion artifacts. We present experimental results corresponding to microbeads and a biological sample to demonstrate the proposed 3-D fluorescence imaging technique.

1.

Introduction

Fluorescence imaging is an important technique to get the functional information of a biological sample for cellular and microbiological investigations, as has been proved by several studies.113 Most of the reported fluorescence imaging techniques are either two-dimensional in nature or involve sectioning to get three-dimensional (3-D) information, such as laser scanning confocal microscopy and other related techniques.111 These techniques are time-consuming processes to obtain the 3-D information of objects. Further techniques have been developed by using digital holography in fluorescence microscopy to record and retrieve the 3-D information of a fluorescent object.12,13 However, by adopting digital holography or other interferometric systems for 3-D fluorescence imaging, the imaging systems become more complicated due to the involvement of an additional reference beam. So, it is desirable to further investigate 3-D fluorescence imaging techniques to develop simple, compact, and cost-effective solutions.

Noninterferometric imaging techniques, such as those based on the transport of intensity equation (TIE), have been proposed for quantitative phase imaging,1422 which does not require a reference beam and hence makes the system simple and compact. Teague proposed the TIE from the Helmholtz equation under the paraxial approximation with the assumption of a monochromatic and coherent beam.14 Some reported variants of the TIE method work with partial coherence illumination.1520 Hence, the TIE technique has an additional advantage of robustness against disturbance under the partially coherent illumination, which extends its application to microscopy.1722 In these techniques, it is often inevitable or desirable that the field should be partially coherent. Generally, the TIE method requires two or three intensity measurements recorded at different planes to retrieve the phase distribution. In addition to simple optical phase microscopy, it has been demonstrated that accurate and high-quality quantitative phase imaging can be achieved by imaging techniques based on TIE with partially coherent illuminations to prevent image degradation due to speckle noise.1520 Focus estimation has also been proposed in TIE phase imaging using inverse Fresnel propagation.21,22 To apply this concept in fluorescence imaging could be advantageous in different applications requiring 3-D fluorescence imaging.

Here, we propose the use of the TIE for the 3-D fluorescence imaging. With the help of a TIE-based phase retrieval algorithm and Fresnel backpropagation, images focused at different distances can be obtained from three defocused fluorescent images recorded in multiple planes. To the best of our knowledge, this is the first paper to demonstrate 3-D fluorescence imaging of biological samples by TIE. Although fluorescence light is incoherent, the partial spatial coherence of defocused images obtained by propagation is available when specific conditions, such as small fluorescence light sources (from nuclei of the cells) and narrow bandwidth, are assumed. Note that the phase distribution is measured in the image defocused plane, not in the object plane where the nuclei of the cells exist. The proposed imaging system is simple and straightforward and can be used for different kinds of fluorescent samples. The idea is demonstrated experimentally by developing a specific 3-D microscopy optical setup.

2.

Methodology

The optical setup of the proposed 3-D fluorescence imaging system is shown in Fig. 1. In this system, a blue LED light source was used to excite the sample placed on the stage. Three defocus intensity images were recorded by changing the optical power of the commercially available electrically tunable lens (ETL), EL-16-40-TC from Optotune, to solve the TIE for obtaining the phase distributions at the output plane. The ETL is inserted at the Fourier plane of the first lens. In this setup, the magnification ratio is fixed even when the object is located at different depth positions. The ETL is basically a variable focal length lens8,10 that is used to implement nonmovable TIE.17 After solving TIE by using these images, the phase distribution can be retrieved.1622

Fig. 1

The 3-D fluorescence imaging setup. LED, light-emitting diode; L, lens; TL, tube lens; ETL, electrically tunable lens; MO, microscope objective; M, mirror; DM, dichroic mirror; and BPF, bandpass filter.

JBO_25_3_032004_f001.png

It is well known that the light emitted by a fluorescence sample is not coherent. However, in the applications of biological samples, fluorescence proteins are stained to the cells, and then the fluorescence distribution of nucleus is assumed as a quasi-point-like monochromatic source, because its size is about 10  μm. Besides, in our optical system, a band-pass filter with a central wavelength of 575 nm and width of 10 nm is used to increase the temporal coherence. Therefore, partial spatial coherence of the fluorescence light can be considered after propagation through the optical system even if there is no coded aperture.13 For the partial coherence field, the generalized definition of TIE for phase has been discussed in Refs. 15 and 16 and it has been demonstrated in several studies to obtain phase distributions.1719 In case of partial coherence field, the TIE can be derived from the Helmholtz equation, which is explained as follows:

Eq. (1)

.[Iz(x,y)×ϕz(x,y)]=2πλIz(x,y)z,
where λ, Iz(x,y), and ϕz(x,y), are the wavelength, intensity distributions, and phase distributions at depth z, respectively. The symbol is the gradient operator in the transverse plane (x,y). The TIE for the phase is solved by using Fourier transform (FT).1622 Here, we consider the intensity distribution, I0(x,y), and defocus intensity distributions can be captured, which are to be located at axial positions z=0 and z=±Δz, respectively. The obtained phase can be determined by the following equation:

Eq. (2)

ϕ0(x,y)=2πλFT1[14π2(u2+v2)FT[.I0(x,y)×FT1{14π2(u2+v2)×FT{I0(x,y)z}}]].

In the previous equation, u and v are the spatial frequencies corresponding to x and y coordinates, respectively. The intensity derivative used in Eq. (2) is calculated approximately by using the difference between the two intensity distributions obtained at depth positions Δz and Δz, as is shown in the following equation:

Eq. (3)

I0(x,y)z=IΔz(x,y)IΔz(x,y)2Δz.
Hence, the phase distribution can be retrieved by combining Eqs. (2) and (3). It should be noted that the intensity image I0(x,y) can also be a defocused version of the input object. Yet, our method allows to record the light field corresponding to the selected axial distance with the TIE-based algorithm. However, in the original TIE method, focus image and in- and out-of-focus images are always used to get phase information.

Now the complex amplitude, H(x,y), is obtained by multiplying the square root of the intensity image, I0(x,y), with the retrieved phase, ϕ0(x,y), and this complex amplitude is Fresnel propagated. From the back- or forward-propagated distribution, intensity images of the fluorescent samples can be estimated at multiple planes located at different distances.21,22

3.

Experiments and Results

Various experiments were performed to verify the proposed method for 3-D fluorescence imaging using the optical setup shown in Fig. 1. Microscope objective of 20× magnification was used for imaging fluorescent microbeads and a biological sample. In the first experiment, single plane fluorescence imaging of microbeads of 10.4  μm diameter is verified and the focusing capability is demonstrated. A blue LED of 470-nm wavelength was used as an excitation light source for the microbeads. The fluorescent microbeads emit light with a wavelength ranging from 550 to 600 nm. A bandpass filter centered at 575 nm with a bandwidth of 10 nm was used in front of the image sensor. The effective pixel number of the image sensor is 700×700  pixels with a pixel pitch of 4.54  μm.

Results of single plane fluorescence imaging are shown in Fig. 2. Three defocus intensity images of fluorescent microbeads were recorded, as shown in Figs. 2(a)2(c), by changing the focal length of the ETL. A focus intensity image of the input plane was also recorded to compare it with the retrieved focused fluorescent image obtained with the proposed method. The defocus distances of the three recorded images from the ideal focus image are 20, 30, and 40  μm, respectively. From these images, the phase image corresponding to the intensity image shown in Fig. 2(b) was retrieved by solving the TIE. The result is shown in Fig. 2(d). Here, the image shown in Fig. 2(b) is treated as the intensity distribution I0, as used in Eqs. (2) and (3), and the images shown in Figs. 2(a) and 2(c) are considered as IΔz and IΔz, respectively, for solving the TIE. Figure 2(e) shows the surface plot of the retrieved phase. The focus image, shown in Fig. 2(f), was recovered after backpropagation of the complex function calculated from the amplitude image, shown in Fig. 2(b), and the corresponding retrieved phase. The original focus image recorded in the experiment is shown in Fig. 2(g). Figure 2(h) shows the line plot across the image of the bead on the recovered and the original focus images. Here, the reconstruction distance from central defocus image is 24 mm. From these results, it can be seen that the focus image can be obtained successfully from the three defocus images, which proves the capability of our method to provide 3-D fluorescence imaging.

Fig. 2

Experimental results for single plane imaging. (a)–(c) Three defocus intensity images, (d) the reconstructed phase image, (e) surface plot of phase, (f) recovered focus image, (g) original focus image recorded in the experiment, and (h) line plot on the recovered and original focus image.

JBO_25_3_032004_f002.png

Another experiment was performed to demonstrate the 3-D fluorescence imaging capability of the proposed method. For this experiment, two layers of fluorescent beads were prepared on glass slides with a separation of more than 80  μm and again, three defocus images were recorded, as shown in Figs. 3(a)3(c). In this case, defocus images were recorded in between with an interval of 5  μm. The phase image shown in Fig. 3(d) corresponds to the phase associated with the intensity image in Fig. 3(b). This image in Fig. 3(b) is considered as I0; the images shown in Figs. 3(a) and 3(c), as IΔz and IΔz, respectively. Figure 3(e) shows the surface plot of the phase distribution in Fig. 3(d). Figure 3(e) indicates that the defocused image to obtain the complex amplitude distribution is located at a farther position than that of Fig. 2(e). The maximum phase amount depends on the distance from the observed defocused plane to the focused plane to be reconstructed. The effect of two beads located at different distances is clearly noticeable. The complex light field is determined from the retrieved phase and its corresponding intensity image. Images focused at different planes, showing clear intensity images of the beads, were recovered by Fresnel propagation of the complex function. These recovered focus images are shown in Figs. 3(f) and 3(g). The corresponding original images, with beads in focus, recorded experimentally by conventional imaging, are shown in Figs. 3(h) and 3(i). Reconstruction distance from the central defocus image for the upper bead is 45 mm to positive side and 36 mm for other beads to the negative side from the measurement plane. Figures 3(j) and 3(k) show line plot across the images of beads of the recovered and original intensity distributions in both planes. From these results, it can be confirmed that the 3-D fluorescence imaging can be performed by our proposed method.

Fig. 3

Experimental results for double plane imaging. (a)–(c) Three defocus intensity images, (d) the reconstructed phase image using TIE-based phase retrieval, and (e) surface plot of the phase in (d). Recovered focus images in which (f) one bead is at focus and (g) second bead is at focus. Original focus images recorded in a conventional imaging experiment, where (h) one of the beads is at focus and (i) the second bead is at focus. (j), (k) Line plots of the intensity along the position of the beads on the recovered and the original image for (j) the first focusing distance and (k) the second focusing distance.

JBO_25_3_032004_f003.png

In the third experiment, the 3-D imaging capability of the proposed method was verified on a biological sample. GCaMP-expressing neurons in a cerebral slice of 100  μm thickness from a CaMK2-CreERT2/Rosa-GCaMP323 mouse treated with tamoxifen were visualized by anti-GFP immunostaining with Cy3-tyramine signal amplification system. For this sample, a green LED of the central wavelength of 575 nm was used as the light source to excite the fluorescent-labeled neurite and cells. The fluorescent-labeled neurite and cells emit light with a wavelength ranging from 620 to 640 nm, thus a bandpass filter centered at 630 nm was used in front of the image sensor. The three experimentally recorded defocus images of the biological sample are shown in Figs. 4(a)4(c). Fluorescent light from neurite can be clearly seen. These defocus images were recorded with an interval of 2  μm. Here, the sample is shifted along the depth direction by a translation stage to obtain the defocused images instead of ETL. The retrieved phase obtained by TIE algorithm corresponding to the intensity images in Figs. 4(a)4(c) is shown in Fig. 4(d). The surface plot of the phase is shown in Fig. 4(e). From the complex field retrieved from the phase in Fig. 4(d) and intensity in Fig. 4(b), reconstructed images in the image plane at different depths of 22, 26, and 30 mm can be recovered, which are shown in Figs. 4(f)4(h), respectively. From these results, it can be concluded that with our proposed technique, it is possible to perform 3-D fluorescence imaging of biological sample in multiple planes from defocused intensity images.

Fig. 4

Experimental results for fluorescence from neurite and cells. (a)–(c) Three defocus intensity images; (d) reconstructed phase image; (e) surface plot of phase in (d); (f)–(h) recovered intensity images at distances of 22, 26, and 30 mm, respectively, from measurement plane.

JBO_25_3_032004_f004.png

4.

Conclusion

In this work, we have presented a scanless 3-D fluorescence imaging scheme based on the TIE technique that uses the Fresnel backpropagation of a complex wave function calculated from the phase retrieved by TIE and its corresponding intensity image. In the proposed imaging technique, the phase distribution corresponding to defocus fluorescence images is retrieved by a phase retrieval algorithm based on TIE. Images focused at different planes can be estimated from the complex distribution after the numerical calculation of inverse Fresnel propagation. Through the proposed imaging approach, it is straightforward to perform 3-D fluorescence imaging in multiple planes. Real-time imaging, for example, for live-cell imaging will be also possible because intensity fluorescence images can be captured with the help of fast ETLs and focus images are retrieved by fast FT-based numerical methods. The feasibility of the proposed 3-D fluorescence imaging method is demonstrated by experimental results obtained from distributions of microbeads and a biological sample.

Disclosures

The authors declare that there are no conflicts of interest related to this article.

Acknowledgments

O. M, S. K. R., and M. K. acknowledge financial support from Grants-in-Aids for Scientific Research from the Ministry of Education, Culture, Sports, Science, and Technology in Japan; Award No. 17F17369, 18H03888, and 17F17370, and Japan Science and Technology Agency; Award No. JPMJCR1755. This study was partly supported by a CREST grant from AMED (JP18gm0910012 to T.F.) and Grants-in-Aids for Scientific Research from the Ministry of Education, Culture, Sports, Science, and Technology in Japan (18H05429 to T.F.) E. T. acknowledges financial support from Generalitat Valenciana (PROMETEO/2016/079) and Ministerio de Economía y Competitividad, MINECO (FIS2016-75618-R).

References

1. 

U. Kubitscheck, Fluorescence Microscopy: From Principles to Biological Applications, 2nd ed.Wiley-VCH, Weinheim (2017). Google Scholar

2. 

E. P. Buurman et al., “Fluorescence lifetime imaging using a confocal laser scanning microscope,” Scanning, 14 155 –159 (1992). https://doi.org/10.1002/sca.v14:3 SCNNDF 0161-0457 Google Scholar

3. 

J. W. Lichtman and J. A. Conchello, “Fluorescence microscopy,” Nat. Methods, 2 910 –919 (2005). https://doi.org/10.1038/nmeth817 1548-7091 Google Scholar

4. 

I. Pavlova et al., “Understanding the biological basis of auto fluorescence imaging for oral cancer detection: high-resolution fluorescence microscopy in viable tissue,” Clin. Cancer Res., 14 2396 –2404 (2008). https://doi.org/10.1158/1078-0432.CCR-07-1609 Google Scholar

5. 

M. Egeblad et al., “Visualizing stromal cell dynamics in different tumor microenvironments by spinning disk confocal microscopy,” Dis. Models Mech., 1 155 –167 (2008). https://doi.org/10.1242/dmm.000596 Google Scholar

6. 

F. Kawamoto, “Rapid diagnosis of malaria by fluorescence microscopy with light microscope and interference filter,” Lancet, 337 200 –202 (1991). https://doi.org/10.1016/0140-6736(91)92159-Y Google Scholar

7. 

Z. Wang et al., “Single shot, three-dimensional fluorescence microscopy with a spatially rotating point spread function,” Biomed. Opt. Express, 8 5493 –5506 (2017). https://doi.org/10.1364/BOE.8.005493 BOEICL 2156-7085 Google Scholar

8. 

Z. Wang et al., “Compact multi-band fluorescent microscope with an electrically tunable lens for autofocusing,” Biomed. Opt. Express, 6 4353 –4364 (2015). https://doi.org/10.1364/BOE.6.004353 BOEICL 2156-7085 Google Scholar

9. 

Q. Ma et al., “Three-dimensional fluorescent microscopy via simultaneous illumination and detection at multiple planes,” Sci. Rep., 6 31445 (2016). https://doi.org/10.1038/srep31445 SRCEC3 2045-2322 Google Scholar

10. 

J. M. Jabbour et al., “Optical axial scanning in confocal microscopy using an electrically tunable lens,” Biomed. Opt. Express, 5 645 –652 (2014). https://doi.org/10.1364/BOE.5.000645 BOEICL 2156-7085 Google Scholar

11. 

J. Zheng et al., “Dual-mode phase and fluorescence imaging with a confocal laser scanning microscope,” Opt. Lett., 43 5689 –5692 (2018). https://doi.org/10.1364/OL.43.005689 OPLEDP 0146-9592 Google Scholar

12. 

J. Rosen and G. Brooker, “Non-scanning motionless fluorescence three-dimensional holographic micoroscopy,” Nat. Photonics, 2 190 –195 (2008). https://doi.org/10.1038/nphoton.2007.300 NPAHBY 1749-4885 Google Scholar

13. 

X. Quan et al., “Three-dimensional stimulation and imaging-based functional optical microscopy of biological cells,” Opt. Lett., 43 5447 –5450 (2018). https://doi.org/10.1364/OL.43.005447 OPLEDP 0146-9592 Google Scholar

14. 

M. R. Teague, “Deterministic phase retrieval: a Green’s function solution,” J. Opt. Soc. Am., 73 1434 –1441 (1983). https://doi.org/10.1364/JOSA.73.001434 JOSAAH 0030-3941 Google Scholar

15. 

C. Zuo et al., “Transport of intensity phase retrieval and computational imaging for partial coherent fields: the phase space perspectives,” Opt. Lasers Eng., 71 20 –32 (2015). https://doi.org/10.1016/j.optlaseng.2015.03.006 Google Scholar

16. 

D. Paganin and K. A. Nugent, “Non interferometric phase imaging with partially coherent light,” Phys. Rev. Lett., 80 2586 –2589 (1998). https://doi.org/10.1103/PhysRevLett.80.2586 PRLTAO 0031-9007 Google Scholar

17. 

C. Zuo et al., “High-speed transport-of-intensity phase microscopy with an electrically tunable lens,” Opt. Express, 21 24060 –24075 (2013). https://doi.org/10.1364/OE.21.024060 OPEXFF 1094-4087 Google Scholar

18. 

W. Yu et al., “Real time quantitative phase microscopy based on single-shot transport of intensity equation (ssTIE) method,” Appl. Phys. Lett., 109 071112 (2016). https://doi.org/10.1063/1.4961383 APPLAB 0003-6951 Google Scholar

19. 

X. Tian et al., “Real-time quantitative phase imaging based on transport of intensity equation with dual simultaneously recorded field of view,” Opt. Lett., 41 1427 –1430 (2016). https://doi.org/10.1364/OL.41.001427 OPLEDP 0146-9592 Google Scholar

20. 

C. H. Chen et al., “Non-interferometric phase retrieval using refractive index manipulation,” Sci. Rep., 7 46223 (2017). https://doi.org/10.1038/srep46223 SRCEC3 2045-2322 Google Scholar

21. 

X. Tian et al., “In-focus quantitative intensity and phase imaging with the numerical focusing transport of intensity equation method,” J. Opt., 18 105302 (2016). https://doi.org/10.1088/2040-8978/18/10/105302 Google Scholar

22. 

K. Komuro and T. Nomura, “Object plane detection and phase amplitude imaging based on transport of intensity equation,” Opt. Rev., 24 626 –633 (2017). https://doi.org/10.1007/s10043-017-0356-5 1340-6000 Google Scholar

23. 

T. Ebina et al., “3D clustering of GABAergic neurons enhances inhibitory actions on excitatory neurons in the mouse visual cortex,” Cell Rep., 9 1896 –1907 (2014). https://doi.org/10.1016/j.celrep.2014.10.057 Google Scholar

Biography

Sudheesh K. Rajput is a JSPS postdoctoral research fellow at Kobe University, Japan. He received his BS and MS degrees in physics in 2006 and 2008, respectively, from Chhatrapati Shahu Ji Maharaj University, in Kanpur, India, and his PhD in optics in 2015 from the Indian Institute of Technology, Patna, India. His research interests include optical security, optical sound-field imaging, digital holography and transport of intensity equation imaging, and multimodal systems for fluorescence and phase imaging.

Manoj Kumar received his MTech degree in instrumentation from the National Institute of Technology Kurukshetra, in 2011 and his PhD in optical engineering from the Indian Institute of Technology Delhi, New Delhi, in 2016. Presently, he is a JSPS postdoctoral research fellow at Kobe University, Japan. His research interests include 3D imaging, biomedical optics, digital holography, speckle metrology, and optical instrumentation. He is a member of the Optical Society of America (OSA).

Xiangyu Quan is an assistant professor in the Department of System Informatics at Kobe University, Japan. She received her BS degree from Beijing Information Science and Technology University in China, and received her ME and DE degrees from Kobe University, in 2015 and 2017, respectively. Her research interests include quantitative phase imaging microscopy, 3D fluorescence microscopy and optogenetic light stimulations tools by digital holographic methods. She is a member of OSA and SPIE.

Mitsuhiro Morita is an associate professor at the Graduate School of Sciences, Kobe University. He received his PhD in biology from Kobe University. His research interests include neuroscience, focusing on pathophysiological functions of glial cells, and bioimaging, especially calcium imaging. He is a member of the Japanese Neuroscience Society.

Tomoyuki Furuyashiki is a professor and the chair of the Division of Pharmacology, Graduate School of Medicine, Kobe University, Japan. He obtained his PhD in 2001 from Kyoto University, Japan. His current research interest is to understand molecular, cellular, and neural-circuitry mechanisms underlying stress-induced mental and bodily changes and to translate the findings to stress-related disorders, such as depressions, in clinics.

Yasuhiro Awatsuji received his BE, ME and DE degrees from Osaka University, in 1992, 1994 and 1997, respectively. He was a research associate from 1997 to 2005, and an associate professor from 2005 to 2014 at Kyoto Institute of Technology (KIT). He has been a professor at KIT since 2014. His research interests are in the area of information optics with emphasis on holography. He is a senior member of SPIE and OSA.

Enrique Tajahuerce is an associate professor in the Department of Physics at Universitat Jaume I, Castelló, Spain. He develops his research at the Institute of New Imaging Technologies (INIT) in the same university. He received his PhD in physics from Universidad de Valencia, Spain, in 1998. His research interests include diffractive optics, adaptive optics, digital holography, computational imaging, imaging through scattering media, and single-pixel imaging. He is a senior member of SPIE.

Osamu Matoba is a professor at the Graduate School of Systems Science, Kobe University. He received his PhD in applied physics from Osaka University. His research interests include multimodal 3D imaging using digital holography, transport of intensity equation, light field and optical sound field imaging, imaging through scattering tissue, and 3D display. He is a fellow of OSA and SPIE.

© The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Sudheesh K. Rajput, Manoj Kumar, Xiangyu Quan, Mitsuhiro Morita, Tomoyuki Furuyashiki, Yasuhiro Awatsuji, Enrique Tajahuerce, and Osamu Matoba "Three-dimensional fluorescence imaging using the transport of intensity equation," Journal of Biomedical Optics 25(3), 032004 (12 November 2019). https://doi.org/10.1117/1.JBO.25.3.032004
Received: 30 June 2019; Accepted: 4 September 2019; Published: 12 November 2019
JOURNAL ARTICLE
7 PAGES


SHARE
Advertisement
Advertisement
Back to Top