The development of a simple, robust high-resolution fluorescence endomicroscope is driven by preclinical and clinical needs.^{1} Standard wide-field techniques are hampered by their inability to to reject out-of-focus background, generally leading to low signal contrast. Strategies to reduce out-of-focus background have been based on confocal detection^{2, 3, 4, 5, 6} or two-photon excitation,^{7, 8} both requiring some sort of scanning mechanism. Alternatively, out-of-focus background can be rejected in a nonscanning wide-field endoscope by use of structured illumination microscopy (SIM),^{9} which we have implemented with a flexible fiber bundle.^{10} While SIM is effective at optical sectioning, we have found that it is highly susceptible to sample motion, the difficulty being that high-resolution image information in SIM is distributed over a series of at least three raw images, meaning that any misregistration between the raw images leads to artifacts in the final processed SIM image. Recently, we have developed a novel hybrid-illumination technique to address this problem.^{11} In this technique, two raw images are required, only one containing high-resolution information and the other containing low-resolution information. Hence, the name of our new imaging technique: HiLo microscopy.

The two raw images required for HiLo microscopy are based respectively on uniform and nonuniform (or structured) illumination. In our initial implementation of HiLo microscopy, the nonuniform illumination was obtained with laser speckle.^{11} However, HiLo microscopy is more general than this and can be implemented with any type of nonuniform illumination. In particular, we demonstrate here the implementation of HiLo endomicroscopy with nonuniform illumination in the form of a grid pattern, of the same type as used in SIM. Indeed, our HiLo endomicroscope setup is identical to our previous SIM endomicroscope setup (see Fig. 1
), except that for HiLo, the spatial light modulator now toggles between two illumination patterns, grid and uniform, whereas for SIM, it sequentially produced three grid patterns of incrementing phase.^{10}

The principle of HiLo microscopy was described in Ref. 11. In brief, a final optically sectioned HiLo image is constructed from the fusion of complementary in-focus high- and low-frequency image components. High-frequency components in the uniform illumination image are inherently in focus and are extracted with a high-pass filter. In-focus low-frequency components, on the other hand, must be extracted in a more complicated manner, since the simple application of a low-pass filter to the uniform illumination image does not reject out-of-focus background. To reject low-frequency out-of-focus background, we evaluate the local contrast in the fluorescence image obtained with nonuniform illumination. This local contrast is higher for in-focus image components than for out-of-focus components and hence is axially resolved. A multiplication of the local image contrast with the original uniform illumination image then provides an optically sectioned image, although at low resolution. A fusion of this in-focus low-resolution image with the complementary high-resolution image (inherently in focus) then leads to a full-resolution image that is axially resolved over all spatial frequencies within the microscope passband.

A key step in HiLo microscopy is the extraction of local image contrast from the nonuniform illumination image. In our previous implementation where the nonuniform illumination consisted of laser speckle, this local image contrast was evaluated by calculating the standard deviation of the nonuniform illumination image intensity over local, coarse-grained resolution areas. In our current implementation with a grid pattern, we will adopt a slightly different, although essentially equivalent, approach based on single-sideband demodulation. To understand this approach, let us phenomenologically decompose our uniform illumination image ${I}_{u}\left(\stackrel{\u20d7}{\rho}\right)$ into in-focus and out-of-focus components. That is, we write

## Eq. 1

${I}_{u}\left(\stackrel{\u20d7}{\rho}\right)={I}_{\mathit{\text{in}}}\left(\stackrel{\u20d7}{\rho}\right)+{I}_{\mathit{\text{out}}}\left(\stackrel{\u20d7}{\rho}\right),$The nonuniform image can be decomposed similarly into

## Eq. 2

${I}_{n}\left(\stackrel{\u20d7}{\rho}\right)={I}_{\mathit{\text{in}}}\left(\stackrel{\u20d7}{\rho}\right)[1+M\phantom{\rule{0.2em}{0ex}}\mathrm{sin}({\kappa}_{g}x+\phi )]+{I}_{\mathit{\text{out}}}\left(\stackrel{\u20d7}{\rho}\right),$${I}_{n}\left(\stackrel{\u20d7}{\rho}\right)$ and ${I}_{u}\left(\stackrel{\u20d7}{\rho}\right)$ are the two raw images required for HiLo microscopy. The ratio $R\left(\stackrel{\u20d7}{\rho}\right)={I}_{n}\left(\stackrel{\u20d7}{\rho}\right)\u2215{I}_{u}\left(\stackrel{\u20d7}{\rho}\right)$ of these two images leads to

## Eq. 3

$R\left(\stackrel{\u20d7}{\rho}\right)=1+C\left(\stackrel{\u20d7}{\rho}\right)M\phantom{\rule{0.2em}{0ex}}\mathrm{sin}({\kappa}_{g}x+\phi ),$There are two difficulties with the preceding procedure. First, the sidebands
${\mathcal{R}}_{-}\left(\stackrel{\u20d7}{\kappa}\right)$
and
${\mathcal{R}}_{+}\left(\stackrel{\u20d7}{\kappa}\right)$
may be so wide as to overlap. This problem can be alleviated by choosing a one-sided, high-pass filter cutoff profile that helps suppress the overlap region. The second problem is that, in general,
$M$
is not known *a priori*. We thus define a new parameter
${I}_{su}\left(\stackrel{\u20d7}{\rho}\right)={\left[{R}_{+}\left(\stackrel{\u20d7}{\rho}\right){R}_{+}^{*}\left(\stackrel{\u20d7}{\rho}\right)\right]}^{1\u22152}{I}_{u}\left(\stackrel{\u20d7}{\rho}\right)$
that is independent of
$M$
. Moreover, we purposefully restrict
${I}_{su}\left(\stackrel{\u20d7}{\rho}\right)$
to spatial frequencies smaller than
${\kappa}_{g}$
by applying a low-pass filter to
${I}_{su}\left(\stackrel{\u20d7}{\rho}\right)$
, with user-defined cutoff frequency
${\kappa}_{c}\u2a7d{\kappa}_{g}$
, obtaining
${I}_{\mathit{lp}}\left(\stackrel{\u20d7}{\rho}\right)=\mathrm{LP}\left[{I}_{su}\left(\stackrel{\u20d7}{\rho}\right)\right]$
. In practice,
$\mathrm{LP}\left[{I}_{su}\left(\stackrel{\u20d7}{\rho}\right)\right]$
is performed by convolving
${I}_{su}\left(\stackrel{\u20d7}{\rho}\right)$
with a square window of size
$2\pi \u2215{\kappa}_{g}$
(or integral multiple thereof, to minimize the possibility of aliasing). In addition to confining
${I}_{su}\left(\stackrel{\u20d7}{\rho}\right)$
to a well-defined bandwidth, such filtering helps suppress potential artifacts arising, for example, from a nonperfectly sinusoidal illumination pattern.

Finally, the low-resolution image ${I}_{\mathit{lp}}\left(\stackrel{\u20d7}{\rho}\right)$ is combined with complementary high-resolution information ${I}_{\mathit{hp}}\left(\stackrel{\u20d7}{\rho}\right)$ obtained by applying a high-pass filter directly to the uniform illumination image, such that ${I}_{\mathit{hp}}\left(\stackrel{\u20d7}{\rho}\right)=\mathrm{HP}\left[{I}_{u}\left(\stackrel{\u20d7}{\rho}\right)\right]={I}_{u}\left(\stackrel{\u20d7}{\rho}\right)-\mathrm{LP}\left[{I}_{u}\left(\stackrel{\u20d7}{\rho}\right)\right]$ . The final processed HiLo image is given by

## Eq. 4

${I}_{\mathit{hilo}}\left(\stackrel{\u20d7}{\rho}\right)=\eta {I}_{\mathit{lp}}\left(\stackrel{\u20d7}{\rho}\right)+{I}_{\mathit{hp}}\left(\stackrel{\u20d7}{\rho}\right),$Figure 3 provides comparisons of standard wide-field and HiLo endomicroscope images through a fiber bundle. It should be noted that a longer grid period leads to a stronger imaged modulation depth $M$ —however, at the expense of weaker HiLo optical sectioning capacity. A grid period of $30\phantom{\rule{0.3em}{0ex}}\mu \mathrm{m}$ was found to provide a reasonable compromise between grid pattern contrast and HiLo optical sectioning capacity. A rough measure of this sectioning capacity can be inferred from a measurement of the detected signal strength from a uniform fluorescent half-space whose interface is scanned through the focal plane. A comparison of the signal strengths acquired with wide-field and HiLo endomicroscopy is illustrated in Fig. 3d, where we observe that the HiLo signal strength decays much more precipitously than the wide-field signal strength. The corresponding HiLo axial resolution for a laterally uniform plane is inferred from the derivative of the HiLo signal strength, and is found, in this case, to be about $30\text{-}\mu \mathrm{m}$ FWHM. Note that for a laterally uniform sample, ${I}_{\mathit{hp}}\left(\stackrel{\u20d7}{\rho}\right)$ vanishes, and the HiLo image is comprised solely of ${I}_{\mathit{lp}}\left(\stackrel{\u20d7}{\rho}\right)$ .

Finally, a comparison of wide-field and HiLo endomicroscopic imaging of colon tissue in motion is illustrated in the multimedia movies ( Videos 1 and Videos 2 ). Note the absence of a residual grid pattern or other motion-related artifacts. Our net HiLo imaging acquisition rate was about $2\phantom{\rule{0.3em}{0ex}}\mathrm{Hz}$ (i.e., $250\phantom{\rule{0.3em}{0ex}}\mathrm{ms}$ per raw image). This rate was software limited and will be improved in future versions of our apparatus. Our imaging resolution is about $2.6\phantom{\rule{0.3em}{0ex}}\mu \mathrm{m}$ , limited by the Nyquist frequency associated with the (magnified) fiber core quasiperiodicity (see Ref. 10).

10.1117/1.3130266.110.1117/1.3130266.2In conclusion, we have successfully demonstrated the capacity of HiLo microscopy to provide optically sectioned imaging of fluorescently labeled colon tissue through a flexible optical fiber bundle. We anticipate that this will open new possibilities in high-resolution fluorescence endomicroscopy.

## References

*in vivo*as observed using fluorescent fiber-optics confocal microscopic imaging,” J. Invest. Dermatol., 121 706 –712 (2003). https://doi.org/10.1046/j.1523-1747.2003.12477.x 0022-202X Google Scholar

*in vivo*fluorescence analysis,” Opt. Express, 15 4008 –4017 (2007). https://doi.org/10.1364/OE.15.004008 1094-4087 Google Scholar

*In vivo*confocal and multiphoton microendoscopy,” J. Biomed. Opt., 13 010501 (2008). https://doi.org/10.1117/1.2839043 1083-3668 Google Scholar