1 September 2010 Enhancing precision in time-domain fluorescence lifetime imaging
Author Affiliations +
J. of Biomedical Optics, 15(5), 056013 (2010). doi:10.1117/1.3494566
In biological applications of fluorescence lifetime imaging, low signals from samples can be a challenge, causing poor lifetime precision. We demonstrate how optimal signal gating (a method applied to the temporal dimension of a lifetime image) and novel total variation denoising models (a method applied to the spatial dimension of a lifetime image) can be used in time-domain fluorescence lifetime imaging microscopy (FLIM) to improve lifetime precision. In time-gated FLIM, notable fourfold precision improvements were observed in a low-light example. This approach can be employed to improve FLIM data while minimizing sample light exposure and increasing imaging speed.
Chang and Mycek: Enhancing precision in time-domain fluorescence lifetime imaging



Fluorescence lifetime imaging and fluorescence lifetime imaging microscopy (FLIM) are molecular imaging techniques that are useful for preclinical and clinical studies in living cells, small animals, and human tissues, with fluorophore excited-state lifetime providing image contrast.1

However, low fluorescence signals from biological samples can be a challenge, causing poor lifetime precision, and this will affect, to a great extent, the quantitative applications of FLIM, such as the detection of Förster resonance energy transfer for molecular interactions and the sensing of fluorophore microenvironments.2, 3, 4, 5 When endogenous fluorophores are imaged, low fluorescence signals may result from low intrinsic fluorophore concentrations and/or unfavorable optical properties of fluorophores (e.g., fluorescence excitation and emission wavelengths, quantum yield, photobleaching rate). When exogenous fluorophores are imaged, low signals can result from the low fluorophore concentrations that are required to minimize effects on sample physiology and/or from the low transfer efficiency of fluorophores/fluorophore precursors (genes or different forms of fluorophores) from extracellular media into live cells. To increase measured fluorescence signals from biological samples, high-intensity excitation sources, such as lasers, can be used in FLIM, but this may cause unexpected cell responses and sample damage,6, 7 and may also increase photobleaching rates. Another way to increase fluorescence signals is to use lower excitation intensity coupled with longer image acquisition times, but sample movement will be a major concern of this approach in live-cell imaging.8 Considering the above challenges, a combination of low fluorescence signals, low excitation light intensity, and fast image acquisition can make FLIM data very imprecise in biological applications.

In this study, we focused on lifetime precision improvements in time-gated FLIM, where fluorescence intensities at different delay times along a decay curve were integrated by a detector, as in Fig. 1 . To improve the precision of lifetime determination in FLIM, error analysis with Monte Carlo (MC) simulations may be used to determine optimal gating schemes.8, 9, 10, 11, 12 Optimal gating schemes of rapid lifetime determination (RLD) for single-exponential decays (a two-gate protocol) with respect to relative standard deviation [(RSD), also commonly known as coefficient of variation] of lifetime have been reported,10, 12 and an error analysis of RLD for double-exponential decays has also been addressed.11 Recently, optimization of fluorescence lifetime sensing in frequency domain was studied.13 In our laboratory, we constructed optimal gating schemes for double-exponential decays with several different lifetime determination methods.14 In this report, because of the robustness15 of the single-exponential four-gate protocol (Sec. 3.2), we used this protocol and determined its optimal gating schemes with both MC simulations and analytical solutions (Sec. 4.1) for the first time, and then used the optimal schemes to improve the precision of time-gated FLIM (Sec. 4.2) under low-light and fast imaging (up to 20Hz ). The approach presented here helps avoid sample damage, photobleaching, and unwanted sample movement detection in fluorescence lifetime imaging applications.

Fig. 1

Instrumentation schematic for (a) time-gated FLIM and (b) the concept of time gating. The time-gated system was a wide-field system with an intensifier for the control of gating. With the time-gated system, the intensities along decay curves were integrated by the detector. CCD=charge -coupled device, g=gate width; dt=time interval between the starting points of two consecutive gates; black solid arrows: electronic signals; blue dotted arrows: optical signals. (Color online only.)


In addition, we combined optimal gating with image “denoising” (Sec. 3.5), which also has the potential to improve FLIM precision. The term “to denoise” means “to remove noise,” especially the noise introduced by imaging systems. The image-processing algorithms commonly used to denoise images can be either local or global. Local denoising algorithms [such as Gaussian smoothing, Tikonov denoising, and total variation (TV) model denoising] are sometimes preferred because they only need neighboring pixels to implement smoothing of a certain region in an image and work well in most cases.16 Global denoising (such as Fourier–Wiener filtering), on the other hand, might be best used for images with repeated patterns, in which fine structures may be preserved because the information of the whole image is adopted to determine the value of a certain pixel in the processed image. A summarized classification of currently used image denoising algorithms, as well as some comparisons among them, has been reported.16

In this study, we demonstrate, for the first time, how optimal gating (a method applied to the temporal dimension of a FLIM image) and TV denoising (a method applied to the spatial dimension of a FLIM image) can be used in combination to improve the precision of lifetime determination in time-gated FLIM. Because the two methods apply to different dimensions, we assume that they can work either independently or in combination. We demonstrate that lifetime precision can be improved in a regime pertinent to live-cell FLIM studies. In addition, both Poisson- and non-Poisson-distributed noise were taken into consideration (Sec. 2) because although Poisson-distributed noise is a common form of noise for photon-counting devices, other forms of noise may appear due to nonunity gain and nonideal behaviors of real imaging systems, as well as image-processing procedures, such as lifetime determination. The models reported here can remove Poisson-distributed noise and other forms of noise with high flexibility and speed.


Theoretical Background

TV models are constructed with the definition of their “energy,” or E , through minimization of which the processed image (u) evolves to a stable state that should be close to the original image without noise corruption. The basic form of the energy [Eq. 1] includes a regularization term, which utilizes total variation (defined as the integral of the absolute value of the gradient of the image, assuming the image is a continuous function) to denoise the input image (f) , and a fidelity term, which implements fitting of the processed image to the input image and decides how large the “distance” can be between these two images. A favorable property of TV models is that they perform selective smoothing and hence are edge-preserving,



The Rudin–Osher–Fatemi model17 is a commonly used TV model, but it assumes that the noise level, or magnitude, is constant. To deal with varying magnitude of noise, which usually occurs in real imaging systems, Le 18 developed a TV model that was suitable for Poisson noise. They demonstrated that Poisson noise in artificial images could be removed with their model, while low-contrast features were preserved in regions of low intensity. Other TV or non-TV denoising methods have also been developed either to handle Poisson noise or to have varying regularization parameters that can potentially be used to remove Poisson noise.19, 20, 21, 22

However, although Poisson-distributed noise is a common form of noise for photon-counting devices, other forms of noise may appear due to nonunity gain and sometimes nonideal behaviors of real imaging systems. In addition, to directly denoise FLIM lifetime maps, the deformed noise distribution after lifetime determination and the dependence of this distribution on intensity and lifetime need to be considered as well. This produces an entirely different form of noise. The novel TV models we used in this study14 not only can deal with Poisson noise, but also can be easily and flexibly adapted to take into consideration any forms of intensity-dependent, lifetime-dependent, or even spatially dependent noise introduced by imaging systems and image-processing procedures.

The novel TV models we developed for this study have the general form, denoted as variance-weighted TV (VWTV),


where Ω denotes the signal domain, Var(f) indicates the local variance of f (as a function of x and y ), λ is the fidelity coefficient, and the variables x and y represent the spatial location of the pixels. The fidelity term (second term on the right-hand side) is a variance-weighted least-squares fitting term. The weighing here helps us to adjust the importance of the fidelity term, based on the local noise level, relative to the TV regularization term, which is the first term on the right-hand side and is the term that removes noise. With this algorithm, the final u that gives minimal E should still look like f (hence, the features are preserved) due to the fitting term, while noise is being removed due to the TV regularization term. The values of λ were determined by the “discrepancy rule,”18 which requires the fidelity term evaluated with f and the final u to be the same as that evaluated with f and the estimated uncorrupted image.14 For the specific application of denoising intensity images, we further developed a novel, modified f -weighted TV (FWTV) model14 based on an f -weighted fidelity term,


where G represents the ratio of the signal variance to the mean intensity counts. G can be either a constant (for imaging systems with constant gain values) or a function of local mean intensity, in which case G=G(f) , which can be evaluated for real imaging systems.14

To implement VWTV and FWTV denoising, the gradient descent method was used to obtain the time derivative of u . The processed image u , with initial guess as f , then evolved through iterations (time steps) to minimize energy.




Time-Gated FLIM

To implement time-gated FLIM, we employed a novel time-domain, wide-field FLIM system for picosecond time-resolved imaging for biological applications [Fig. 1].5, 23 A dye laser (GL-301, Photon Technology International, Lawrenceville, New Jersey) pumped by a nitrogen laser (GL-3300, Photon Technology International, Lawrenceville, New Jersey) for UV–visible–near-infrared (NIR) excitation provided a wide-field, less expensive, and potentially portable alternative to multiphoton excitation for subnanosecond FLIM of biological specimens.23 A sample was illuminated by an excitation pulse, and the fluorescence emission was recorded by an intensified charge-coupled device (ICCD) camera (Picostar HR, LaVision, Germany) at a gate delay controlled by the intensifier, with emission intensities integrated during a gate width. The ICCD had variable intensifier gain and gate width settings varying from 200psto10ms and could be used to implement high-speed imaging in other applications as well.24 In addition, this system had a large temporal dynamic range ( 750ps to ∞), 50ps lifetime discrimination, and spatial resolution of 1.4μm , which made it very suitable for studying a variety of endogenous and exogenous fluorophores in biological samples.2, 4, 25, 26, 27, 28 Fluorescence lifetime maps were determined by first acquiring fluorescence intensity images at four delays and then calculating the lifetime values from the intensity images on a pixel-by-pixel basis (described in Sec. 3.2).

The gating parameters [the gate width, g , and the time interval between the starting points of two consecutive gates, dt , see Fig. 1] can be optimized by using MC simulations10, 11, 12 or applying error propagation (described in Sec. 3.4).


Four-Gate Lifetime Mapping

To create fluorescence lifetime maps rapidly, a four-gate protocol with a linearized least-squares lifetime determination method was used on a pixel-by-pixel basis. This method is more precise than the two-gate protocol while still easy to implement,11, 29, 30


where τp is the lifetime of pixel p , Ii,p is the intensity of pixel p in image i , ti is the gate delay of image i , and N is the number of images. All sums are over i .

Additional steps in data processing are needed for more accurate lifetime map production. Before lifetime calculation, the step “background subtraction” takes average of the intensities of pixels within a specified background region and subtracts that average value from all pixels. After background subtraction, the step “reject” sets intensities to zero for all pixels with intensities below a certain value (assigned as the parameter “reject”). After lifetime calculation, the step “ τ range” sets lifetimes to zero for all pixels with lifetimes above a certain value (assigned as the parameter “taurange”) to remove lifetime values in physically meaningless regions. In this study, “reject” was set to 10 and “taurange” was set to 15.


Sample Preparation and Imaging

Fluorescent beads with diameters of 10μm (Cat. no. 18140, Polysciences, Warrington, Pennsylvania) were suspended in distilled water to produce a solution with a final concentration of 1.5× 106beadsmL . Before imaging, 200μL of the solution was placed on a δ T dish (Bioptechs, Butler, Pennsylvania), and the imaging process with the time-gated FLIM system was begun after the beads had settled to the bottom of the dish. All beads had excitation/emission maxima of 441486nm , as specified by the manufacturer. A 40× microscope objective was used. The voltage across the microchannel plate of the intensifier was set at 800V . The beads were excited at λex=436±10nm using the laser dye coumarin 440 and the fluorescence was collected at λem=480±20nm .


Optimal Gating

In this study, single-exponential gating optimization was utilized. The optimal gating of the four-gate protocol [Eq. 4] was first determined by MC simulations, in which the relative standard deviation (RSD) (defined as the standard deviation divided by the mean value) of the determined lifetime values was minimized by changing the gate width (g) and the time interval between the starting points of two consecutive gates (dt) , assuming that only Poisson noise was present (Fig. 2 ). In addition, g and dt did not vary with different gates, meaning that once g and dt are chosen for a simulation, the g values for all the four gates are the same and the dt values between the first and second, second and third, and third and fourth gates are the same as well. For a different simulation, new g and dt values will be chosen. Because these distributions were constructed by MC simulations with the repetitive addition of noise, RSD provided a quantitative measurement of the precision of the determination of a certain parameter, such as lifetime. Because this study considered only a single-exponential decay, the intensity profile could be written as I(t)=αexp(tτ) , and the RSD of either α (the pre-exponential term) or τ (the lifetime) could be minimized. In this study, we optimized the gating scheme for the best precision of τ determination.

Fig. 2

MC simulation procedure for evaluating the precision of lifetime determination. The decay model I(t) , gate width g , time interval dt between two consecutive gates, and the correct values of lifetime τ and pre-exponential term α were used to simulate the noise-free integrated fluorescence intensity. Then, Poisson noise was added, and the τ and α values retrieved from the noise-corrupted signals (denoted as τ and α ) were recorded in each iteration to build up a histogram over a number of iterations of noise addition and lifetime determination. The RSD was calculated from the histogram distribution, and this histogram buildup process was then repeated with different g and dt values. The optimal g and dt occurred when minimal RSD values were achieved. In this study, single-exponential decay was considered and RSD was evaluated only for τ .


Alternatively, the RSD of the lifetime determined by the four-gate protocol could be analytically determined by applying error propagation to Eq. 4, with the assumption that the variance of the fluorescence intensity was the same as the intensity magnitude, which is a characteristic of Poisson noise. Again, the optimal gating parameters were determined when the minimal RSD was achieved.

As mentioned above, other forms of noise in addition to Poisson noise may appear in real imaging systems. This will be considered in our future studies and should further improve FLIM precision with optimal gating.


Total Variation Denoising

Two approaches were used with TV denoising to improve the precision of lifetime determination in FLIM. In “lifetime denoising” [Fig. 3 ], a lifetime map was first constructed by four-gate lifetime mapping. Because the variance of lifetime was not proportional to the lifetime values, VWTV [Eq. 2] was used. The variance estimation, as a function of τ , g , dt , and total photon counts [(TC), the photon counts integrated under the entire decay curve, see Fig. 1], was performed by analytically solving the error propagation of Eq. 4, which led to the following equation:


In “intensity denoising” [Fig. 3], each time-gated intensity image was denoised before four-gate lifetime mapping. In this case, TV denoising was performed with FWTV [Eq. 3], using the values of G previously characterized as a function of local mean intensity, because other forms of noise, in addition to Poisson noise, were expected.14

Fig. 3

The precision of lifetime determination in FLIM was improved by either (a) lifetime denoising, where the estimated variance of lifetime values was used in VWTV for denoising of lifetime maps or (b) intensity denoising, where estimated G was used in FWTV for denoising of each intensity image before four-gate lifetime mapping.



Results and Discussion


Determining Optimal Gating

The RSD values as a function of lifetime-scaled dt and g were consistent (Fig. 4 ) whether obtained from the MC simulation (Fig. 2) or the analytical solution [derived from Eq. 4], especially for high total photon counts (or TC=10,000 ). The analytical solution suggests that the RSD of lifetime is inversely proportional to (TC)12 , which can be observed in Figs. 4 and 4: The contours had exactly the same shapes with tenfold differences in their values. When TC was large enough (TC=10,000) , the MC simulation and analytical results were consistent. When TC was small (TC=100) , higher RSD values were predicted by MC simulation in the outer nonoptimal regions.

Fig. 4

Contour plots of the relative standard deviation (RSD) of the lifetime values determined by MC simulation (Fig. 2) with (a) TC=10,000 , (b) TC=100 and by analytical solution [derived from Eq. 4] with (c) TC=10,000 and (d) TC=100 . dt and g were scaled by the lifetime τ . The analytical solution suggests that the RSD of lifetime is inversely proportional to (TC)12 , which can be observed in (c) and (d). When TC was large enough (TC=10,000) , the MC simulation and analytical results were consistent. When TC was small (TC=100) , higher RSD was predicted by MC simulation in the outer nonoptimal regions. The dashed lines (gτ=3) were further inspected with dtτ=0.15 , 0.3, 0.75, and 1.5 (labeled with open circles) in Fig. 5 along with experimental data. Number of MC simulations=10,000 . The sampling grids: For MC simulation, dtτ=0.051.5 with 0.05 increments and gτ=110 with 0.5 increments; for analytical solution dtτ=0.051.5 with 0.01 increments and gτ=110 with 0.1 increments.


Fig. 5

Percent RSD (relative standard deviation) in calculated lifetime (dashed lines and open circles in Fig. 4) and experimentally measured lifetime, as a function of the time interval dt (in nanoseconds) between two consecutive gates. The RSD values of the measured lifetime were determined from the lifetime values retrieved from the nonzero pixels in the FLIM images of the experimentally prepared fluorescent beads. The simulation/analytically determined value of optimal dt (2.5ns) was verified by the experiments to produce lower lifetime RSD than the surrounding dt values. The gate width was fixed at 10ns , and the TC were 100 .


Indeed, we do not expect the results from both methods to be exactly the same. The accuracy of the analytical solution may suffer from the linearization approximation in error propagation derivation, therefore underestimating the RSD when the errors were highly nonlinear at low photon counts [Fig. 4 versus Fig. 4]. On the other hand, the MC simulation should be more accurate at low photon counts, but the accuracy may suffer from the limited number of simulations and the usually more discretized parameter values used as inputs for the simulations.

In spite of the differences in the results of the two methods, both results from the MC simulations and the analytical solutions suggested the same optimal gating scheme, which was independent of TC: The optimal dt was 0.75 of the lifetime value and the optimal g should be greater than at least threefold of the lifetime value (only negligible improvement exists once g4τ ). In this case, the gates actually overlap. Although the determination of the optimal gating scheme requires the lifetime value of the sample, an approximate lifetime value is usually available from previous knowledge of the sample, or a test experiment with arbitrary gating.

Therefore, for the fluorescent bead sample mentioned above (Sec. 3.3) with lifetime value of 3.3ns (determined with the time-gated FLIM system), the optimal gating should be around dt=2.5ns and g10ns . This prediction was validated experimentally, as shown in Fig. 5 .

What can also be observed in Fig. 4 is that apparently RSD had a greater dependence on dt than on g . Therefore, in our experimental validation of the optimal gating (Fig. 5), we only changed dt (the open circles in Fig. 4) around its optimal value, 2.5ns , while having g fixed at 10ns (the dashed lines in Fig. 4).

Figure 5 shows that the RSD curve from analytical solution (TC=100) overlapped with that from MC simulation (TC=10,000) multiplied by 10. This means that when TC was high, the curves from two approaches were consistent. As mentioned previously, the MC simulation at low TC predicted higher RSD when the gating was not optimal. All these three curves had the minimal RSD at dt=2.5 ns, which was confirmed by the RSD curve from the experimental data.

The above approach assumed single-exponential decay. If the number of components in the sample is unknown, then the suggested procedure will be to use the optimal gating of single-exponential decay first, aiming at the averaged lifetime value, to acquire the least noisy overall decay behavior. This curve can then be fitted with single- and double-exponential decay to determine which one fits the curve better. For a decay curve with more than two components, however, more than four gates will be needed (see below).

As for the optimal gating with more than one decay component, first, we can further apply the optimal gating schemes of double-exponential decays, which have been constructed in our laboratory, for lifetime precision improvement, either independently or in combination with image denoising.14 More than two components can also be considered in the future, using the same procedure shown in Fig. 2. However, in this case, at least 2×(thenumberofdecaycomponents) gates are needed to fit the intensity profile and solve all the parameters (there are one lifetime and one pre-exponential term for each component), and the computational work for the optimal gating determination will become much more complicated.


Improving Precision of Lifetime Determination in Time-Gated FLIM


Reduction in relative standard deviation

Optimal gating, lifetime denoising, and intensity denoising all improve FLIM precision. This is demonstrated in Fig. 6 , where the noise distribution within the FLIM maps of fluorescent beads is illustrated. We note that this is a fairly low-light case with total photon counts only around 100. The holes inside the fluorescent beads [Fig. 6] came from one of the lifetime calculation steps, in which the τ values above a certain threshold were set to zero. Because this threshold was set to τ=15ns , random fluctuations in low-light imaging caused some pixels to have lifetime values more than four times larger than the expected values if the gating scheme was not optimal. After intensity denoising [Fig. 6], the image became smoother and the RSD value dropped to 46%, but the extremely high τ values above the threshold still could not be removed. This was similar to the lifetime-denoised map [ RSD=49% , Fig. 6]. Optimal gating [Fig. 6] removed these artifacts and further decreased the RSD value to 20.1%, as well as reducing the diameter of the beads so that it became closer to the actual bead size of 10μm . This effect on the spatial pattern was actually due to the fact that more pixels were properly “rejected” in data processing (Sec. 3.2) after denoising. Further improvement was then achieved by denoising the optimally gated image with either the denoising approach [ RSD=14.7% and 13.7%, Figs. 6 and 6, for lifetime denoising and intensity denoising, respectively]. A comparison of Fig. 6 to Fig. 6 [or to Fig. 6] shows that most of the remaining lifetime random variations within the beads in the optimally gated image could be removed by denoising. Here, the combination of optimal gating and TV denoising resulted in about a fourfold improvement in precision. In addition, the results in Fig. 6 suggested that the improvement from the intensity denoising ( 6% , in this case) could be independent of that from optimal gating ( 32% , in this case). Although 6% may seem small relative to an RSD of 51.5% (nonoptimal gating), it is quite large relative to an RSD of 20.1% (optimal gating), because it is a one-third reduction in RSD. Therefore, image denoising is particularly important when optimal gating is also applied.

Fig. 6

FLIM images of fluorescent beads acquired with a gate width of 10ns and different values of the time interval dt between two consecutive gates: (a) dt=0.5ns , undenoised; (b) dt=2.5ns (optimal), undenoised; (c) dt=0.5ns , lifetime denoised; and (d) dt=2.5ns (optimal), lifetime denoised; (e) dt=0.5ns , intensity denoised; and (f) dt=2.5ns (optimal), intensity denoised. The nonoptimally gated intensity images, optimally gated intensity images, and their corresponding FWTV-denoised images are shown in Fig. 7. The improvements in precision by optimal gating and TV denoising in combination are easily observable in this low-light case (TC=100) . The labeled RSD values were obtained from all pixels with lifetime of > 2 to remove the variations from the background values. Scale bar: 10μm .


Fig. 7

The (a) nonoptimal and (b) optimal gating schemes, and (c) the nonoptimally and (d) optimally gated intensity images, and (e,f) their corresponding FWTV-denoised images, respectively, used to obtain the results shown in Fig. 6. In (a) and (b), the red solid lines represent gate start time points, while the blue dotted lines represent corresponding gate end time points in the same sequence from left to right. (c–f) are shown in the same spatial order as the intensity image stacks representing them in Fig. 6. Also, in each of (c–f), gates 1–4 are shown in the upper-left, upper-right, lower-left, and lower-right panels, respectively. Scale bar: 10μm . (Color online only.)


The nonoptimally and optimally gated intensity images, their gating schemes, and their corresponding FWTV-denoised images are shown in Fig. 7 . We can clearly see that, because the optimal gating had a larger dt value [Fig. 7 versus 7], the intensity decay trace could be more easily observed in Fig. 7 compared to Fig. 7. This was also true for Fig. 7 compared to Fig. 7. On the other hand, after denoising, the removal of noise [Fig. 7 versus Fig. 7 and Fig. 7 versus Fig. 7] was obvious while the geometry of the beads was not affected.

In this section, we conclude that optimal gating and image TV denoising can be employed either independently or in combination to improve precision in low-light time-gated FLIM. When these two methods are combined, their overall fourfold (from 51.5 to 13.7%) improvements in precision can be easily observed in our low-light example (Fig. 6).


Lifetime denoising versus intensity denoising

We note that when comparing lifetime denoising and intensity denoising in terms of RSD, intensity denoising had a greater influence on the precision of lifetime determination than lifetime denoising. However, it is obvious that they actually produced somewhat different denoised lifetime maps [Fig. 6 versus 6, and Fig. 6 versus 6]. Their individual strengths and weaknesses arise from their different denoising mechanisms. Lifetime denoising appeared to be worse for removing the irregularities in the geometry of objects arising from noise [such as the noisy edges in Figs. 6 and 6]. This was probably because TV denoising is edge preserving, and therefore, the irregular edges could not be easily removed once they were already introduced into the lifetime map by noise. On the other hand, lifetime denoising appeared to be better for smoothing off-edge, internal pixels for pattern revealing because it worked directly on the lifetime map and therefore could remove the overall uncertainties from the intensity images at once (as long as they were not on the edges). These uncertainties may have a better chance to remain unremoved after individual and independent intensity image denoising.


Broader Applications

Our techniques can be further applied to time-correlated single-photon counting (TCSPC) FLIM, which is a commonly used method for live-cell lifetime imaging. Optimal gating could be applied to TCSPC FLIM by virtual gating, in which the values of data points within each virtual gate were summed up to form an intensity image. The four-gate protocol can again be used for virtually gated TCSPC FLIM. Similarly, denoising approaches, including both intensity denoising and lifetime denoising, can also be applied to TCSPC FLIM. It has been demonstrated that a greater than fivefold improvement in lifetime precision can be achieved in TCSPC FLIM images when optimal virtual gating and TV denoising are applied in combination.31

As for the image denoising methods alone, it will be interesting and useful to employ, optimize, and compare other image denoising techniques specifically for the applications of FLIM, either independently or in combination with optimal (virtual) gating.

Finally, because optimal denoising improves other advanced image processing techniques such as image deconvolution,32 segmentation, and object tracking, the combination of denoising and these techniques can also be studied specifically for FLIM use.



We report promising techniques that can remove uncertainties and improve precision in time-domain FLIM maps. With time-gated FLIM, notable fourfold improvements in lifetime precision (RSD from 51.5 to 13.7%) can be easily observed in our low-light (total photon counts=100 ) example.

Theoretically, optimal signal gating is generally applicable because the relative RSD reduction is independent of feature geometry and total photon counts and, therefore, it should work for all kinds of samples (different lifetime values will have different optimal schemes, though, according to the results in Sec. 4.1). Furthermore, our novel TV denoising models have been tested on artificial images with different geometries and lifetime values,14 and the results indicated that our TV models could always improve local lifetime determination while still preserving lifetime fidelity. The algorithms reported here have been encoded in Matlab for ease of implementation.

In conclusion, the approach presented here helps improve FLIM data while increasing imaging speed and minimizing sample light exposure to avoid biological sample damage, photobleaching, and unwanted sample movement detection in FLIM applications.


This work was supported in part by a research grant from National Institutes of Health (No. NIH CA-114542).



C. W. Chang, D. Sud, and M. A. Mycek, “Fluorescence lifetime imaging microscopy,” Methods Cell Biol.0091-679X 81, 495–524 (2007).10.1016/S0091-679X(06)81024-1Google Scholar


C. W. Chang, M. Wu, S. D. Merajver, and M. A. Mycek, “Physiological fluorescence lifetime imaging microscopy improves Förster resonance energy transfer detection in living cells,” J. Biomed. Opt.1083-3668 14(6), 060502 (2009).10.1117/1.3257254Google Scholar


D. Schweitzer, S. Schenke, M. Hammer, F. Schweitzer, S. Jentsch, E. Birckner, W. Becker, and A. Bergmann, “Towards metabolic mapping of the human retina,” Microsc. Res. Tech.1059-910X 70(5), 410–419 (2007).10.1002/jemt.20427Google Scholar


D. Sud and M. A. Mycek, “Calibration and validation of an optical sensor for intracellular oxygen measurements,” J. Biomed. Opt.1083-3668 14(2), 020506 (2009).10.1117/1.3116714Google Scholar


W. Zhong, M. Wu, C. W. Chang, K. A. Merrick, S. D. Merajver, and M. A. Mycek, “Picosecond-resolution fluorescence lifetime imaging microscopy: a useful tool for sensing molecular interactions in vivo via FRET,” Opt. Express1094-4087 15(26), 18220–18235 (2007).10.1364/OE.15.018220Google Scholar


K. Konig, T. W. Becker, P. Fischer, I. Riemann, and K. J. Halbhuber, “Pulse-length dependence of cellular response to intense near-infrared laser pulses in multiphoton microscopes,” Opt. Lett.0146-9592 24(2), 113–115 (1999).10.1364/OL.24.000113Google Scholar


K. R. Rau, A. Guerra, A. Vogel, and V. Venugopalan, “Investigation of laser-induced cell lysis using time-resolved imaging,” Appl. Phys. Lett.0003-6951 84(15), 2940–2942 (2004).10.1063/1.1705728Google Scholar


D. S. Elson, I. Munro, J. Requejo-Isidro, J. McGinty, C. Dunsby, N. Galletly, G. W. Stamp, M. A. A. Neil, M. J. Lever, P. A. Kellett, A. Dymoke-Bradshaw, J. Hares, and P. M. W. French, “Real-time time-domain fluorescence lifetime imaging including single-shot acquisition with a segmented optical image intensifier,” New J. Phys.1367-2630 6, 180 (2004).10.1088/1367-2630/6/1/180Google Scholar


C. W. Chang and M. A. Mycek, “Improving precision in time-gated FLIM for low-light live-cell imaging,” Proc. SPIE0277-786X 7370, 7370091 (2009).Google Scholar


R. M. Ballew and J. N. Demas, “An error analysis of the rapid lifetime determination method for the evaluation of single exponential decays,” Anal. Chem.0003-2700 61(1), 30–33 (1989).10.1021/ac00176a007Google Scholar


K. K. Sharman, A. Periasamy, H. Ashworth, J. N. Demas, and N. H. Snow, “Error analysis of the rapid lifetime determination method for double-exponential decays and new windowing schemes,” Anal. Chem.0003-2700 71(5), 947–952 (1999).10.1021/ac981050dGoogle Scholar


P. D. Waters and D. H. Burns, “Optimized gated detection for lifetime measurement over a wide-range of single exponential decays,” Appl. Spectrosc.0003-7028 47(1), 111–115 (1993).10.1366/0003702934048622Google Scholar


A. Esposito, H. C. Gerritsen, and F. S. Wouters, “Optimizing frequency-domain fluorescence lifetime sensing for high-throughput applications: photon economy and acquisition speed,” J. Opt. Soc. Am. A0740-3232 24(10), 3261–3273 (2007).10.1364/JOSAA.24.003261Google Scholar


C. W. Chang, “Improving accuracy and precision in biological applications of fluorescence lifetime imaging microscopy,” PhD Thesis, University of Michigan, ⟨http://deepblue.lib.umich.edu/bitstream/2027.42/63765/1/chingwei_1.pdf⟩ (2009).Google Scholar


H. C. Gerritsen, M. A. H. Asselbergs, A. V. Agronskaia, and W. G. J. H. M. Van Sark, “Fluorescence lifetime imaging in scanning microscopes: acquisition speed, photon economy and lifetime resolution,” J. Microsc.0022-2720 206, 218–224 (2002).10.1046/j.1365-2818.2002.01031.xGoogle Scholar


A. Buades, B. Coll, and J. M. Morel, “A review of image denoising algorithms, with a new one,” Multiscale Model. Simul.1540-3459 4(2), 490–530 (2005).10.1137/040616024Google Scholar


L. I. Rudin, S. Osher, and E. Fatemi, “Nonlinear total variation based noise removal algorithms,” Physica D0167-2789 60(1–4), 259–268 (1992).10.1016/0167-2789(92)90242-FGoogle Scholar


T. Le, R. Chartrand, and T. J. Asaki, “A variational approach to reconstructing images corrupted by Poisson noise,” J. Math. Imaging Vision0924-9907 27(3), 257–263 (2007).10.1007/s10851-007-0652-yGoogle Scholar


P. Besbeas, I. De Feis, and T. Sapatinas, “A comparative simulation study of wavelet shrinkage estimators for Poisson counts,” Int. Statist. Rev.0306-7734 72(2), 209–237 (2004).10.1111/j.1751-5823.2004.tb00234.xGoogle Scholar


S. J. Reeves, “Optimal space-varying regularization in iterative image-restoration,” IEEE Trans. Image Process.1057-7149 3(3), 319–324 (1994).10.1109/83.287028Google Scholar


W. Vanzella, F. A. Pellegrino, and V. Torre, “Self-adaptive regularization,” IEEE Trans. Pattern Anal. Mach. Intell.0162-8828 26(6), 804–809 (2004).10.1109/TPAMI.2004.15Google Scholar


H. S. Wong and L. Guan, “Adaptive regularization in image restoration by unsupervised learning,” J. Electron. Imaging1017-9909 7(1), 211–221 (1998).10.1117/1.482639Google Scholar


P. Urayama, W. Zhong, J. A. Beamish, F. K. Minn, R. D. Sloboda, K. H. Dragnev, E. Dmitrovsky, and M. A. Mycek, “A UV-visible-NIR fluorescence lifetime imaging microscope for laser-based biological sensing with picosecond resolution,” Appl. Phys. B0946-2171 76(5), 483–496 (2003).Google Scholar


Z. Xu, M. Raghavan, T. L. Hall, C. W. Chang, M. A. Mycek, J. B. Fowlkes, and C. A. Cain, “High speed imaging of bubble clouds generated in pulsed ultrasound cavitational therapy-histotripsy,” IEEE Trans. Ultrason. Ferroelectr. Freq. Control0885-3010 54(10), 2091–2101 (2007).10.1109/TUFFC.2007.504Google Scholar


D. Sud, G. Mehta, K. Mehta, J. Linderman, S. Takayama, and M. A. Mycek, “Optical imaging in microfluidic bioreactors enables oxygen monitoring for continuous cell culture,” J. Biomed. Opt.1083-3668 11(5), 050504 (2006).10.1117/1.2355665Google Scholar


D. Sud, W. Zhong, D. G. Beer, and M. A. Mycek, “Time-resolved optical imaging provides a molecular snapshot of altered metabolic function in living human cancer cell models,” Opt. Express1094-4087 14(10), 4412–4426 (2006).10.1364/OE.14.004412Google Scholar


P. K. Urayama and M. A. Mycek, “Fluorescence lifetime imaging microscopy of endogenous biological fluorescence,” in Handbook of Biomedical Fluorescence, M. A. Mycek and B. W. Pogue, Eds., Marcel Dekker, New York (2003).Google Scholar


W. Zhong, P. Urayama, and M. A. Mycek, “Imaging fluorescence lifetime modulation of a ruthenium-based dye in living cells: the potential for oxygen sensing,” J. Phys. D0022-3727 36(14), 1689–1695 (2003).10.1088/0022-3727/36/14/306Google Scholar


I. Bugiel, K. König, and H. Wabnitz, “Investigation of cell by fluorescence laser scanning microscopy with subnanosecond time resolution,” Lasers Life Sci.0886-0467 3(1), 47–53 (1989).Google Scholar


X. F. Wang, T. Uchida, D. M. Coleman, and S. Minami, “A two-dimensional fluorescence lifetime imaging system using a gated image intensifier,” Appl. Spectrosc.0003-7028 45(3), 360–366 (1991).10.1366/0003702914337182Google Scholar


C. W. Chang and M. A. Mycek, “Precise fluorophore lifetime mapping in live-cell, multi-photon excitation microscopy,” Opt. Express1094-4087 18(8), 8688–8696 (2010).10.1364/OE.18.008688Google Scholar


D. Sud and M. A. Mycek, “Image restoration for fluorescence lifetime imaging microscopy (FLIM),” Opt. Express1094-4087 16(23), 19192–19200 (2008).10.1364/OE.16.019192Google Scholar

Ching-Wei Chang, Mary-Ann Mycek, "Enhancing precision in time-domain fluorescence lifetime imaging," Journal of Biomedical Optics 15(5), 056013 (1 September 2010). http://dx.doi.org/10.1117/1.3494566

Fluorescence lifetime imaging



Image processing

Imaging systems

Photon counting

Systems modeling

Back to Top