|
1.IntroductionIn biological tissue, optical scattering limits the focusing of light to depths within the optical diffusion limit of in soft tissue.1,2 This limitation greatly restricts the utility of optical diagnostic and therapeutic techniques, such as optogenetics, microsurgery, optical tweezing, and phototherapy of deep tissue, which require focused light in order to function.3–7 However, optical scattering is, on certain timescales, deterministic, allowing for compensation using several methods.8–20 One such technique, digital optical phase conjugation (DOPC), circumvents the optical diffusion limit through time reversal.21–25 A spatial light modulator (SLM) phase conjugates the optical wavefront incident on the SLM to maximize the light energy reaching a greater depth in a scattering medium. This allows DOPC to focus light through scattering media by causing scattered photons to evolve approximately backward in time as they travel back to their origin. Because DOPC relies on the principle of time reversal, it is imperative that the symmetry between forward and backward photon propagation be maintained. Time-reversal symmetry relies primarily on two key aspects of the DOPC system. First, to ensure that back propagating photons follow the same paths as in the initial scattering, the scattering medium must be deterministic. The time for which the scattering medium may be assumed to be deterministic, known as the scattering correlation time, determines the time limit for recording and playback by the DOPC system, beyond which focusing is no longer possible.25–27 Second, the phase of the scattered wavefront must be conjugated as accurately as possible to enable back propagation of photons to their origin.15 While some inaccuracy may be tolerated, imperfect conjugation results in poor focal quality, quantified by a decreased peak-to-background ratio (PBR). This need for precision poses a significant challenge when a high-quality DOPC system is constructed. Precise alignment of optical components, especially the SLM, is critical in order to measure the optimal phase map and ensure accurate mapping from the scientific complementary metal-oxide semiconductor (sCMOS) camera to the SLM for display. DOPC may be implemented using phase-shifting holography, which requires precise alignment of optical components for an accurate phase measurement. The incident reference beam should be orthogonal to the SLM to make a uniform reference beam with both constant amplitude and phase interfere with the scattered light to maximize the period of the fringes. If the SLM is tilted or tipped out of alignment, the reference beam and, subsequently, the back-reflected sample beam, will also become misaligned, reducing the focal quality of the DOPC system. It should be noted, however, that this statement applies only to systems where the SLM is viewed by the sCMOS camera, which have become increasingly common due to their relative ease of alignment. DOPC systems in which the sCMOS camera does not view the SLM are also used, and require that the SLM be held at the same angle as the sCMOS camera with respect to the reference and sample beams, necessitating different methods of alignment and optimization.15,28 In order to correctly measure and conjugate the phase of scattered light through phase-shifting holography, a planar-wavefront is preferred for the reference beam. DOPC systems must, therefore, compensate for any aberration. Aberration typically arises from misalignment of and imperfection in lenses, curvature of mirrors and, most importantly, misalignment and curvature of the SLM. A compensation phase map must, therefore, be created to correct such artifacts using the SLM.29 In addition, the SLM itself must be carefully aligned with respect to the sCMOS camera. Because the sCMOS camera is responsible for measuring the conjugate phase map, while the SLM is used in display, mapping of the optimal phase map from one device to the other must be accurate to within a single pixel. Optimally aligning the SLM by precise adjustment of axial rotation as well as translation along the - and -axes is vital to ensure pixel-to-pixel matching. Although minor misalignment may cause only translation of the focus, the PBR diminishes rapidly as the measured and displayed phase maps diverge. Finally, as the focusing quality of the DOPC system degrades when the system drifts, frequent recalibration may be necessary to maintain the best performance of the system. A digital only compensation procedure enables a quick calibration, avoiding lengthy time-consuming iterative steps. Speed of the protocol becomes an important issue in alignment compensation methods such as those using orthonormal rectangular polynomials, which provide sufficient speed, but fail to fully correct misalignment due to their abbreviated compensation procedure.29 Here we present a unified protocol for optimization of a DOPC system, utilizing all digital correction for high-accuracy, high-speed compensation. By integrating look-up table (LUT) optimization, interferometry-based SLM curvature correction, and orthonormal rectangular polynomial aberration correction, our technique fully optimizes the alignment of the SLM relative to the reference beam and sCMOS camera with five degrees of freedom, while also correcting for aberration of the reference beam caused by the system’s components and SLM curvature.30 Five degrees of freedom are utilized by the digital alignment optimization protocol in order to allow high-speed all-digital methods to be used for all targeted corrections. Misalignment along the -axis is primarily minimized during the initial gross alignment using a micropositioner, as discussed in Sec. 2.2. DOPC systems have previously been shown to be much less sensitive to misalignment along the -axis, compared to translation along the - and - axes,28 meaning that manual alignment of the -axis is sufficient to recover the majority of focal quality lost due to misalignment. Using a digital-only compensation method based on autocovariance analysis in LUT optimization, our approach also substantially reduces the number of iterations, and therefore, the amount of time required for optimization. This fast alignment is important both for ease of use, as calibration is frequently required, and for quick measurement when the scattering medium or environmental variables cause instability in the system. In doing so, we successfully optimized our system, increasing the PBR by several orders of magnitude and allowing the system to focus through a 5-mm-thick sample with a transport scattering coefficient of at , providing an optically thick diffusive medium equivalent to 12.5 transport mean free paths. 2.Methods2.1.System LayoutAs shown in Fig. 1, we used an SLM (Pluto NIR-II, Holoeye) with controllable elements. Illumination was provided by a 10-W continuous-wave laser (Verdi V-10, Coherent) at 532 nm wavelength. The sample and reference arms were separated by a polarizing beam splitter (PBS), with a half-wave plate prior to the PBS used to adjust the ratio of illumination to each beam. Both the reference (R) and sample (S) arms were used to acquire the optimal phase map, while a shutter blocked the sample beam in playback. After being split, the sample beam was scattered by a diffusive medium, a 5-mm thick polyurethane phantom with uniformly dispersed titanium dioxide nanoparticles. The scattered light was then gathered by a collection lens and directed by a mirror to the SLM, where it interfered with the reference beam. The surface of the SLM was then imaged to the sCMOS camera (pco.edge 5.5, PCO) by a camera lens, which provided a demagnification of 1.23 times and matched the devices pixel-to-pixel. Because undersampling was used, the full number of controllable elements afforded by the SLM was available for optimization by the system.31 2.2.DOPC System Construction and Initial AlignmentBefore implementing our alignment compensation method, gross alignment of the system must be performed in order to bring the misalignment of the system within the limits of the protocol. This manual alignment is typically required only once, with the digital alignment correction provided by the protocol sufficient to maintain alignment if performed regularly. First, misalignment of the SLM along the -axis is corrected utilizing a micropositioner and interferometry provided by the mirror opposite the sCMOS camera as shown in Fig. 1. A phase pattern of 0 and consisting of an array of crosses is displayed by the SLM. Using the micropositioner, the position of the SLM is then adjusted until the thickness of the lines composing the crosses are minimized, as visualized by the sCMOS camera. After correction of translation along the -axis, alignment of tip and tilt must be optimized. To do so, we utilize back reflection of the laser from the mirror opposite the camera or, depending upon reflectance, the SLM. An iris is placed as early as possible within the path of the DOPC system, ideally just following the aperture of the laser, and the size of the opening minimized as much as possible while still allowing light to pass. The location of the iris is then manually adjusted to direct the minimal beam spot to the approximate center of the SLM, the angular orientation of which is adjusted to back reflect the beam to the iris using a kinematic mount with manually driven actuators. In the case that the intensity of the beam or reflectance of the SLM is insufficient to allow for visualization of the back reflected beam at the iris, the mirror opposite the sCMOS camera may be used as a proxy for the SLM in back reflectance. If the mirror is utilized, the surface of the SLM must then be made parallel to the mirror, which may be accomplished by maximizing the period of the fringes created by interference between the mirror and SLM as visualized by the sCMOS camera. Finally, translation misalignment of the - and -axes is corrected. This alignment is carried out utilizing interferometry, this time paired with the LUT which is later optimized by the compensation protocol. A 0 and pattern is again displayed, consisting of a series of arrows with one arrow at each of the corners of the SLM. The four corners of the SLM are then manually selected as determined by the tip of each arrow visualized by the sCMOS camera and interferometry. The coordinates of the four SLM corners are then utilized to form the LUT, with the entries mapping all other SLM pixels to the sCMOS camera pixels being calculated through interpolation of the four manually selected corners. 2.3.Autocovariance Analysis Look-Up Table OptimizationTo ensure that the sCMOS camera and SLM are matched exactly pixel-to-pixel, an LUT is used. The LUT maps all SLM pixels to their corresponding sCMOS pixels and, in doing so, can correct misalignment of the SLM and sCMOS camera due to relative rotation or translation in the plane of the sCMOS camera sensor. The LUT also permits limited correction of affine transformation due to skew of the SLM relative to the sCMOS camera, but tilt and tip compensation of the SLM is specifically addressed later through the use of orthonormal rectangular polynomials. Because the correlation time of light scattered by diffusive media depends on the stability of both the scattering medium and the DOPC system, it is important to avoid the use of time-consuming iterative methods in LUT optimization. Instead, we utilized a digital compensation method based on autocovariance analysis between a phase pattern displayed by the SLM and the pattern expected at the imaging plane of the sCMOS camera. An array of crosses, each measuring , with a phase of and a background phase of 0 was displayed on the SLM, as seen in Fig. 2(a), which was illuminated only by the reference beam. To visualize this pattern, a Michelson interferometer was created by placing a mirror at the BS prior to the SLM, as shown in Fig. 1. To ensure accurate localization of each cross pattern, the mirror was positioned at an equal distance to the SLM from the BS, where it was also imaged by the sCMOS camera. Once visualized by the sCMOS camera, the pattern was processed by an initial LUT derived from interpolation of the four SLM corners, as determined manually. The processed pattern was then compared to the expected pattern, i.e., the optimal pattern assuming exact 1:1 pixel matching, using autocovariance analysis of the crosses. Because the curvature of the SLM creates fringes, the imaged cross pattern is composed of crosses at both high and low intensities, as seen in Fig. 2(b). Thus when performing autocovariance analysis, the expected position of each individual cross is inspected for similarity with a cross at both the maxima or minima (see Appendix A for pseudocode). As the LUT was adjusted, autocovariance computation quantitatively determined the similarity of the visualized pattern to the expected pattern. The corners were then iteratively moved and the accuracy of each subsequently generated LUT was evaluated using autocovariance analysis. Reaching a maximum autocovariance signals that an optimally accurate LUT had been generated, correcting for alignment errors due to relative rotation and translation in the plane of the SLM and sCMOS camera sensor. Using autocovariance analysis to quantitatively evaluate progressively generated LUTs, we can obtain the optimal LUT without direct evaluation of the DOPC focus as feedback. This approach has several significant advantages. As a purely computational method, autocovariance analysis greatly improves the speed of LUT optimization when compared to iterative DOPC measurement. Although the LUT optimization is still iterative, removing as many iterative steps as possible from the process greatly improves the speed of the alignment compensation. Using a computational approach, we were able to optimize the LUT within tens of seconds. This speed is especially important because drift in alignment creates the need for frequent optimization of DOPC systems. Direct evaluation of alignment using autocovariance analysis also increases the efficiency of LUT optimization by avoiding the confounding variable of decorrelation, which may arise from system instability and movement of the scattering media. Evaluation through DOPC feedback requires that DOPC foci be replicable, but decorrelation of the scattering media through which the focus is formed frequently causes variation in the measured PBR of the focus. Further variation is introduced by system instability, and when paired with the strict alignment requirements of DOPC, may result in large changes in PBR through small shifts in the system. By utilizing autocovariance analysis and iteratively generating LUTs, the optimal LUT can be obtained from a single image acquisition, eliminating potential error due to experimental variation within the runtime of the procedure. Implementing and optimizing the LUT are vital first steps of the alignment process, because they allow a DOPC focus to be achieved without relying on feedback from the DOPC focus itself. Without a LUT and LUT optimization, it is difficult to obtain a DOPC focus. Minute misalignment may render the DOPC system unable to form a focus, and unoptimized LUTs may produce a low-quality focus. 2.4.SLM Substrate Curvature CorrectionCurvature across the SLM substrate introduced during the manufacturing process distorts the wavefront of both the reference and sample beams. Because the system prefers a planar reference beam for accurate phase measurement, this aberration must be corrected. To do so, Michelson interferometry is again utilized. The sample beam is blocked, and only the reference beam is directed to the SLM and mirror, which form the interferometer. Using phase-shifting holography, we obtained a phase map of the SLM curvature. Four intensity measurements were made as the phase of the SLM was rotated, and the phase map was calculated by , where arg computes the principal value of the argument of a complex number (also known as atan2) and , , , and are the recorded intensities when the phases of the SLM are 0, , , and , respectively.21,32 The phase map was then conjugated to create a compensation map for the SLM’s curvature. This compensation map can be used to remove the aberration of the reference beam caused by the curvature of the SLM. 2.5.Angular Correction Utilizing Orthonormal Rectangular PolynomialsRectangular polynomials complete the alignment compensation protocol, allowing the SLM to be digitally aligned orthogonally to the sample beam. Without this alignment, minor variations in the angle of the SLM relative to the reference beam will result in an unintended phase ramp, which may significantly impact the focal quality provided by the system. To digitally adjust the angle of the SLM, rectangular polynomial modes are optimized, the second, third, and fourth of which are defined as tilt, tip, and defocus, as shown in Fig. 3.29,30 Application of the second and third orders corrects tilt and tip, i.e., the vertical and horizontal angles, of the SLM by creating a digital phase ramp, which is displayed on the SLM. The virtual angle of the SLM is controlled by the slope of the phase ramp, while the direction, i.e., tilt versus tip, is determined by the direction of the ramp, as shown in Figs. 3(b) and 3(c). Higher-order polynomials may also be used to compensate for aberration introduced to the reference beam by imperfect or misaligned components in the system. Though typically less influential on the PBR of the focus, correction by the higher-order modes improves the quality of the conjugated phase map by mitigating aberration and restoring the reference beam to a plane wave. For example, the fourth mode, as seen in Fig. 3(d), digitally compensates for decollimation within the reference beam. To optimize the rectangular polynomial, the modes are evaluated in series, with the optimal depth of modulation determined by iterative feedback with the PBR of the DOPC focus. The sensitivity of the compensation map may be determined by adjusting the number of steps when testing the optimal modulation depth for each mode. Likewise, the fidelity of compensation and aberration correction may be increased by tailoring the number of optimized modes. An increasing number of modes results in a corresponding increase in fidelity of compensation, at the cost of speed of optimization. In the same way, a larger number of steps when optimizing the depth of modulation allows for finer optimization. For this reason, we choose to optimize the first 10 modes, excluding the first which is simply piston, with a range of to 10 and a step size of 0.5 for the modulation coefficients of the basis provided by the orthonormal rectangular polynomials.30 Utilizing these parameters, we were able to obtain an optimal phase compensation map within 1 min. Appendix A presents pseudocode and code snippet examples of the optimization process and settings described above. 2.6.Diffusive Optical PhantomsTo test scattering media that are stable under high-power laser illumination, a tissue mimicking phantom with a scattering coefficient comparable to that of biological tissues was fabricated. To minimize Joule heating, which would change the scattering property of the phantom, light absorption must be suppressed as much as possible. Polyurethane with titanium oxide (, white rutile powder, Atlantic Equipment Engineers) nanoparticles as a scattering additive creates a stable medium, with a correlation time greater than the runtime of our alignment compensation procedure. The polyurethane base material consists of isocyanate (part A, PX 5210) and polyol (part B, PX 523), which are liquid at room temperature. A stock solution of () in part A was prepared using the following procedure. Toluene (20 mL) was placed in a clean glass jar (125 mL) and 1 g of was added. The solution was sonicated in a bath sonicator for 6 h until the particles were completely dispersed. Part A (100 g) was added to the same jar and sonicated in the bath sonicator for another 6 h, after which the jar was placed in a rocking mixer for at least 24 h for homogenization. The jar was then placed in a fume hood for a few days until the toluene was completely evaporated from the mixture. This stock solution was diluted with part A to obtain the final concentration of in part A. For phantom fabrication, part B, in a ratio of 100 (part A):85 (part B) by weight, was added into the part mixture, and the solution was mixed thoroughly with a blade mixer for 10 min. The final concentration was 0.2% (w/w) of the total mixture, with a reduced scattering coefficient of and an absorption coefficient of at . This mixed solution was put in a vacuum desiccator to remove trapped air bubbles and prevent undesirable scattering once cured. The sample was gently poured into 6- or 10-cm diameter bacteriological Petri dishes (Falcon, Fisher Scientific) with the inside surface coated with a thin film of petroleum distillates (Mold Release 870NA Aerosol) for easy mold-release after curing. The sample was placed on a leveled platform and left overnight at room temperature for slow curing to prevent thermally driven phase separation and clustering of the scattering particles, followed by baking in an oven at 75°C for for the final curing step. The sample was then separated from the Petri dish mold for measurements. The wavelength-dependent optical properties of the 5-mm-thick phantom were measured by a single integrating sphere installed at the National Institute of Standards and Technology, and the scattering and absorption coefficients were measured by a modified inverse adding double algorithm. The experimental setup and details of the algorithms are described elsewhere.33 3.ResultsAfter the alignment procedure, an optimized LUT and compensation phase map were obtained and applied to the SLM to achieve accurate alignment and calibration of the system. As a result, we were able to significantly increase the quality of the focus as defined by the PBR, and to focus through highly scattering thick diffusive media. 3.1.Contributions of LUT Optimization and SLM Curvature Correction to Focal QualityFirst, in order to produce a DOPC focus for testing, the LUT was optimized to correct misalignment in translation and rotation, and the SLM curvature was compensated for. As shown in Fig. 4(a), an uncorrected SLM has a large substrate curvature, covering a range . Because our SLM can modulate light only over a range of , this phase was wrapped and conjugated in order to obtain the compensation map, as shown in Fig. 4(b). As shown in Fig. 4(c), the corrective phase map accurately compensates for the curvature, greatly increasing the uniformity of the captured interferogram. The fringes from the SLM curvature are almost wholly removed, indicating that the phase differences in the compensated interferogram do not exceed . Some small phase shifts can be seen, likely arising from imperfect measurement when creating the compensation phase map as well as incomplete correction fidelity owing to the digital nature of the phase measurement and display. The performance of our optimization protocol was then quantified using the PBR, defined as the ratio of the average intensity of the focal peak, the area where intensity is greater than half the maximum intensity, to the mean intensity when a random wavefront was displayed by the SLM. As Fig. 5(a) demonstrates, the unoptimized system produces a focus with a PBR of () when scattered by the 5-mm-thick polyurethane phantom. Figure 5(b) shows the distribution of the focal intensity in the vertical dimension, which demonstrates our focal spot size to be (). The speckle size was as calculated by the full width at half maximum of the autocovariance function of the speckle pattern captured by the charge coupled device camera. The maximum theoretical PBR for perfect full-aperture lossless time reversal was, therefore, , meaning that the unoptimized system achieved about of the theoretical maximum. After the LUT was optimized and the curvature was corrected, the focus is shown in Fig. 5(c), with a PBR of (). The vertical intensity distribution in Fig. 5(d) shows a focal spot size of (). Note that this standard deviation of zero results from the same spot size in three separate measurements. The LUT optimized system, therefore, achieved of the theoretical maximum PBR. Our autocovariance analysis LUT and curvature compensation procedure, therefore, produced an improvement of times over the original unoptimized LUT, which was aligned manually by eye with misalignments of and along the - and -axes as well as tilt and tip of and . As is clearly demonstrated, the ability of the system to focus through thick scattering media is also enhanced. 3.2.Orthonormal Rectangular PolynomialsOrthonormal rectangular polynomials complete the alignment compensation protocol by ensuring that the SLM surface is aligned orthogonally to the reference beam. Correcting small variations in the SLM relative to the reference beam improves the focal quality by removing unintended phase ramps. As seen in Fig. 7(a), when focusing through the 5-mm polyurethane phantom, the uncorrected system produces a focus with a PBR of . The area of the focus, as demonstrated by the vertical intensity distribution, Fig. 7(b), was . In comparison, with the completed alignment protocol, the PBR was , as seen in Fig. 7(c), and the area of the focal spot was for the optimized system. The completely aligned system, therefore, achieved of the theoretical maximum enhancement. This optimization represents a times increase in PBR for the corrected versus uncorrected alignment. The compensation phase map obtained through rectangular orthonormal polynomials used for the phantom is shown in Fig. 6(a), with the first 10 modes contributing as shown in Fig. 6(b). Modes two through four contribute substantially to the alignment correction, by correcting the tilt, tip, and focus of the SLM, respectively. This dramatic improvement in PBR clearly demonstrates the utility of our protocol in allowing the DOPC system to achieve focusing in circumstances that would otherwise not allow it. 4.DiscussionDue to its short average mode time, i.e., the runtime of the system per optimized mode, DOPC has emerged as one of the most promising methods for focusing through scattering materials.22 By utilizing an sCMOS camera to globally determine the optimal phase map, DOPC’s performance is no longer restricted by the direct relationship between runtime and the optimized degrees of freedom that hinders many wavefront shaping methods, such as iterative wavefront shaping and measurement of the transmission matrix. However, the use of a camera for wavefront measurement also causes DOPC systems to be highly sensitive to misalignment and aberration, particularly of the SLM and reference beam. Here we have presented a protocol for complete digital alignment of a DOPC system with minimal runtime. Our protocol enables correction of the DOPC system’s SLM in five degrees of freedom, vastly increasing the quality of the DOPC focus produced by the system. In addition, it corrects for aberration introduced by the SLM substrate and system components. By implementing the alignment optimization protocol, we have increased the focal quality, as quantified by PBR, by times. In addition to improving focal quality, we were also successful in focusing through thick scattering media, as shown in Figs. 5 and 7, where the PBR was improved by times when the LUT was corrected and the SLM curvature corrected, and by times once the entire protocol was completed. The alignment correction protocol was developed in our lab and has been utilized in optimizing systems for multiple studies. The procedure was used when aligning DOPC for focusing through of scattering media.32 It was also used to improve the PBR of the world’s fastest binary and full-phase DOPC systems, at the time of publication.8,34 In each case, the protocol enabled large improvements in focal quality, as quantified by PBR, and, in some cases, allowed focusing through the targeted scattering medium. It is important to note that all-digital alignment compensation can correct only relatively small errors in the DOPC system. Without frequent optimization, drift due to system instability and environmental variables may cause misalignment beyond the ability of digital methods to correct. Gross realignment of the system for an approximately optimal alignment must then be completed. For the best results, both skilled system maintenance and frequent digital alignment are crucial. Because the DOPC system must typically be optimized at least daily for the best possible performance, the high speed of the alignment compensation protocol is an important advantage in minimizing downtime. AppendicesAppendix A:Pseudocode and Code SnippetsHere we present pseudocode and code snippets for the control algorithms utilized in our alignment compensation procedure for optimization of the LUT, in SLM substrate curvature correction through interferometry, and in SLM alignment using rectangular modes. This control code was written in MATLAB using manufacturer-supplied software development kits for control and integration of the SLM (Pluto NIR-I, Holoeye), sCMOS camera (pco.edge 5.5, PCO), and data acquisition board (NI-6321, National Instruments). A.1.Autocovariance Analysis Based LUT OptimizationThe following pseudocode for LUT optimization assumes the Michelson interferometer is in place as shown in Fig. 1 and the sample beam is blocked as outlined in Sec. 2.3:
function [t_xb, t_xw, t_yb, t_yw]=ACA(acqImg, lutX, lutY, expectedCross) t_xb = 0; t_xw = 0; t_yb = 0; t_yw = 0; for ii = 1:count isoCross = acqImg([lutY(a(ii),b(ii))- 10:lutY(a(ii),b(ii))+10],[lutX(a(ii),b(ii))-10:lutX(a(ii),b(ii))+10]); %Isolates the area about the %expected location of each cross, with “a” and “b” %corresponding to the X and Y positions of the generated %crosses. isoCross_b = max(max(isoCross))-isoCross; %Represents black %cross isoCross_w = isoCross-min(min(isoCross)); %Represents white %cross YY_b = conv2(isCross_b,expectedCross); %Convolve expected and %acquired crosses. YY_w = conv2(isoCross_w,expectedCross); [dx_b(ii),dy_b(ii)] = find(YY_b == max(max(YY_b)),1); %Find X %and Y coordinates of the maximum value. dx_b(ii) = dx_b(ii)-15; %Normalize the maximum indices based on %expected position. Note: This value will change based on the %size of the isolated are for the acquired cross. dy_b(ii) = dy_b(ii)-15; [dx_w(ii),dy_w(ii)] = find(YY_w == max(max(YY_w)),1); dx_w(ii) = dx_w(ii)-15; dy_w(ii) = dy_w(ii)-15; %Quantify the number of crosses at the expected positions. if dx_b(ii)==0 t_xb = t_xb+1; end if dx_w(ii)==0 t_xw = t_xw+1; end if dy_b(ii)==0 t_yb = t_yb+1; end if dy_w(ii)==0 t_yw = t_yw+1; end end end
for pt1 = -test_range:test_range for pt2 = -test_range:test_range for pt3 = -test_range:test_range for pt4 = -test_range:test_range %Set corners for LUT x1_trial = x1+pt1; x2_trial = x2+pt2; x3_trial = x3+pt3; x4_trial = x4+pt4; y1_trial = y1+pt1; y2_trial = y2+pt2; y3_trial = y3+pt3; y4_trial = y4+pt4; %Construct LUT row_begin = linspace(x1_trial,x3_trial,N); row_end = linspace(x2_trial,x4_trial,N); column_begin = linspace(y1_trial,y2_trial,M); column_end = linspace(y3_trial,y4_trial,M); X=zeros(N,M); Y=zeros(N,M); for ii = 1:N X(ii,:) = linspace(row_begin(ii),row_end(ii),M); end for ii = 1:M Y(:,ii) = linspace(column_begin(ii),column_end(ii),N); end X = round(X); Y = round(Y); [t_xb, t_xw, t_yb, t_yw]=ACA(acqImg, lutX, lutY, expectedCross) %Run ACA %Track results of autocovariance analysis for each corner point and %modify. if (t_xb+t_xw) > max_x y1_max = y1_trial; y2_max = y2_trial; y3_max = y3_trial; y4_max = y4_trial; max_x = t_xb+y_xw; max_x_b = t_xb; max_x_w = t_xw; end if (count_y_b+count_y_w)> max_y x1_max = x1_trial; x2_max = x2_trial; x3_max = x3_trial; x4_max = x4_trial; max_y = count_y_b+count_y_w; max_y_b = count_y_b; max_y_w = count_y_w; end end end end end A.2.SLM Curvature CorrectionThe pseudocode for SLM substrate curvature correction is as follows, with the Michelson interferometer in place as shown in Fig. 1:
A.3.Orthonormal Rectangular Polynomial Aberration and Angular CompensationThe pseudocode for orthonormal rectangular polynomial optimization is as follows, using feedback from the DOPC foci: SLMx = 1080; %SLM X dimension. SLMy = 1920; %SLM Y dimension. Orders = 10; %Number of orders to be used. For this example, 10 are shown. %Normalization terms for unit rectangle. a = 1080/sqrt(SLMx^2+SLMy^2); xmax = a; ymax = sqrt(1-a^2); x = linspace(-xmax,xmax,M); y = linspace(-ymax,ymax,N); rPolynomials = zeros(SLMx,SLMy,orders); %Array for polynomials. for ii = 1:M for jj = 1:N rPolynomials(ii,jj,1) = 1; rPolynomials(ii,jj,2) = sqrt(3)/a*x(ii); rPolynomials(ii,jj,3) = sqrt(3/(1-a^2))*y(jj); rPolynomials(ii,jj,4) = sqrt(5)/(2*sqrt(1-2*a^2+2*a^4))*(3*(x(ii)^2+y(jj)^2)-1); rPolynomials(ii,jj,5) = 3/(a*sqrt(1-a^2))*x(ii)*y(jj); rPolynomials(ii,jj,6) = sqrt(5)/(2*a^2*(1-a^2)*sqrt(1-2*a^2+2*a^4))*(3*(1-a^2)^2*x(ii)^2-3*a^4*y(jj)^2-a^2*(1-3*a^2+2*a^4)); rPolynomials(ii,jj,7) = sqrt(21)/(2*sqrt(27-81*a^2+116*a^4-62*a^6))*(15*(x(ii)^2+y(jj)^2)-9+4*a^2)*y(jj); rPolynomials(ii,jj,8) = sqrt(21)/(2*a*sqrt(35-70*a^2+62*a^4))*(15*(x(ii)^2+y(jj)^2)-5-4*a^2)*x(ii); rPolynomials(ii,jj,9) = sqrt(5)*sqrt((27-54*a^2+62*a^4)/(1-a^2))/(2*a^2*(27-81*a^2+116*a^4-62*a^6))*(27*(1-a^2)^2*x(ii)^2-35*a^4*y(jj)^2-a^2*(9-39*a^2+30*a^4))*y(jj); rPolynomials(ii,jj,10) = sqrt(5)/(2*a^3*(1-a^2)*sqrt(35-70*a^2+62*a^4))*(35*(1-a^2)^2*x(ii)^2-27*a^4*y(jj)^2-a^2*(21-51*a^2+30*a^4))*x(ii); end end
compPMap=zeros(SLMx, SLMy); for zMode=1:orders for modDepth= -range:2*range/(numSteps-1):range zMap=mod(zModeMaps(:,:,zMode),2*pi); %Phase map is modulated by for phase wrapping. testPMap=mod((compPMap+basicPMap+zMap),2*pi)/(2*pi)*255; %255%is used as the SLM provides a 8 bit controller. dispSLM(testPMap); %Display test phase map on SLM. PBR=measPBR(imgCap); %Quantify PBR of acquired focus. if(PBR>optPBR) optPBR=PBR; compPMap=mod(compPMap+zMap,2*pi); end end end DisclosuresCertain commercial equipment, instruments, or materials are identified in this paper in order to specify the experimental procedure adequately. Such identification is not intended to imply recommendation or endorsement by the National Institute of Standards and Technology, nor is it intended to imply that the materials or equipment identified are necessarily the best available for the purpose. AcknowledgmentsWe thank Jim Ballard for help in revision and editing of the manuscript and Dr. Kimberly Briggman for useful discussions. This work was sponsored by NIH Grants No. DP1 EB016986 (NIH Director’s Pioneer Award) and R01 CA186567 (NIH Director’s Transformative Research Award) as well as the NIST Intramural Research Program on Optical Medical Imaging. ReferencesV. Ntziachristos,
“Going deeper than microscopy: the optical imaging frontier in biology,”
Nat. Methods, 7
(8), 603
–614
(2010). https://doi.org/10.1038/nmeth.1483 1548-7091 Google Scholar
L. V. Wang and S. Hu,
“Photoacoustic tomography: in vivo imaging from organelles to organs,”
Science, 335
(6075), 1458
–1462
(2012). https://doi.org/10.1126/science.1216210 SCIEAS 0036-8075 Google Scholar
J. Yang et al.,
“Measuring the lens focal length by laser reflection-confocal technology,”
Appl. Opt., 52
(16), 3812
–3817
(2013). https://doi.org/10.1364/AO.52.003812 APOPAI 0003-6935 Google Scholar
J. Yang et al.,
“Radius measurement by laser confocal technology,”
Appl. Opt., 53
(13), 2860
–2865
(2014). https://doi.org/10.1364/AO.53.002860 APOPAI 0003-6935 Google Scholar
R. K. Wang,
“In vivo full range complex Fourier domain optical coherence tomography,”
Appl. Phys. Lett., 90
(5), 054103
(2007). https://doi.org/10.1063/1.2437682 APPLAB 0003-6951 Google Scholar
G. Yao and L. V. Wang,
“Two-dimensional depth-resolved Mueller matrix characterization of biological tissue by optical coherence tomography,”
Opt. Lett., 24
(8), 537
–539
(1999). https://doi.org/10.1364/OL.24.000537 OPLEDP 0146-9592 Google Scholar
J. Yang et al.,
“Laser differential confocal paraboloidal vertex radius measurement,”
Opt. Lett., 39
(4), 830
–833
(2014). https://doi.org/10.1364/OL.39.000830 OPLEDP 0146-9592 Google Scholar
A. S. Hemphill et al.,
“High-speed single-shot optical focusing through dynamic scattering media with full-phase wavefront shaping,”
Appl. Phys. Lett., 111
(22), 221109
(2017). https://doi.org/10.1063/1.5009113 APPLAB 0003-6951 Google Scholar
R. Horstmeyer, H. Ruan and C. Yang,
“Guidestar-assisted wavefront-shaping methods for focusing light into biological tissue,”
Nat. Photonics, 9
(9), 563
–571
(2015). https://doi.org/10.1038/nphoton.2015.140 NPAHBY 1749-4885 Google Scholar
I. M. Vellekoop and A. P. Mosk,
“Focusing coherent light through opaque strongly scattering media,”
Opt. Lett., 32
(16), 2309
–2311
(2007). https://doi.org/10.1364/OL.32.002309 OPLEDP 0146-9592 Google Scholar
I. M. Vellekoop,
“Feedback-based wavefront shaping,”
Opt. Express, 23
(9), 12189
–12206
(2015). https://doi.org/10.1364/OE.23.012189 OPEXFF 1094-4087 Google Scholar
S. M. Popoff et al.,
“Measuring the transmission matrix in optics: an approach to the study and control of light propagation in disordered media,”
Phys. Rev. Lett., 104
(10), 100601
(2010). https://doi.org/10.1103/PhysRevLett.104.100601 PRLTAO 0031-9007 Google Scholar
M. Cui,
“A high speed wavefront determination method based on spatial frequency modulations for focusing light through random scattering media,”
Opt. Express, 19
(4), 2989
–2995
(2011). https://doi.org/10.1364/OE.19.002989 OPEXFF 1094-4087 Google Scholar
Z. Yaqoob et al.,
“Optical phase conjugation for turbidity suppression in biological samples,”
Nat. Photonics, 2
(2), 110
–115
(2008). https://doi.org/10.1038/nphoton.2007.297 NPAHBY 1749-4885 Google Scholar
M. Cui and C. Yang,
“Implementation of a digital optical phase conjugation system and its application to study the robustness of turbidity suppression by phase conjugation,”
Opt. Express, 18
(4), 3444
–3455
(2010). https://doi.org/10.1364/OE.18.003444 OPEXFF 1094-4087 Google Scholar
A. S. Hemphill, J. W. Tay and L. V. Wang,
“Hybridized wavefront shaping for high-speed, high-efficiency focusing through dynamic diffusive media,”
J. Biomed. Opt., 21
(12), 121502
(2016). https://doi.org/10.1117/1.JBO.21.12.121502 JBOPFO 1083-3668 Google Scholar
E. N. Leith and J. Upatnieks,
“Microscopy by wavefront reconstruction,”
J. Opt. Soc. Am., 55
(5), 981
–986
(1965). https://doi.org/10.1364/JOSA.55.000981 JOSAAH 0030-3941 Google Scholar
M. Kim et al.,
“Transmission matrix of a scattering medium and its applications in biophotonics,”
Opt. Express, 23
(10), 12648
–12668
(2015). https://doi.org/10.1364/OE.23.012648 OPEXFF 1094-4087 Google Scholar
J. Yang et al.,
“Focusing light through scattering media by polarization modulation based generalized digital optical phase conjugation,”
Appl. Phys. Lett., 111
(20), 201108
(2017). https://doi.org/10.1063/1.5005831 APPLAB 0003-6951 Google Scholar
Y. Liu et al.,
“Bit-efficient, sub-millisecond wavefront measurement using a lock-in camera for time-reversal based optical focusing inside scattering media,”
Opt. Lett., 41
(7), 1321
–1324
(2016). https://doi.org/10.1364/OL.41.001321 OPLEDP 0146-9592 Google Scholar
H. Ruan, M. Jang and C. Yang,
“Optical focusing inside scattering media with time-reversed ultrasound microbubble encoded light,”
Nat. Commun., 6 8968
(2015). https://doi.org/10.1038/ncomms9968 Google Scholar
C. Ma et al.,
“Single-exposure optical focusing inside scattering media using binarized time-reversed adapted perturbation,”
Optica, 2
(10), 869
–876
(2015). https://doi.org/10.1364/OPTICA.2.000869 Google Scholar
C. Ma et al.,
“Time-reversed adapted-perturbation (TRAP) optical focusing onto dynamic objects inside scattering media,”
Nat. Photonics, 8
(12), 931
–936
(2014). https://doi.org/10.1038/nphoton.2014.251 NPAHBY 1749-4885 Google Scholar
E. H. Zhou et al.,
“Focusing on moving targets through scattering samples,”
Optica, 1
(4), 227
–232
(2014). https://doi.org/10.1364/OPTICA.1.000227 Google Scholar
Y. Liu et al.,
“Optical focusing deep inside dynamic scattering media with near-infrared time-reversed ultrasonically encoded (TRUE) light,”
Nat. Commun., 6 5904
(2015). https://doi.org/10.1038/ncomms6904 Google Scholar
A. Lev and B. Sfez,
“In vivo demonstration of the ultrasound-modulated light technique,”
J. Opt. Soc. Am. A, 20
(12), 2347
–2354
(2003). https://doi.org/10.1364/JOSAA.20.002347 JOAOD6 0740-3232 Google Scholar
D. Wang et al.,
“Focusing through dynamic tissue with millisecond digital optical phase conjugation,”
Optica, 2
(8), 728
–735
(2015). https://doi.org/10.1364/OPTICA.2.000728 Google Scholar
M. Jang et al.,
“Method for auto-alignment of digital optical phase conjugation systems based on digital propagation,”
Opt. Express, 22
(12), 14054
–14071
(2014). https://doi.org/10.1364/OE.22.014054 OPEXFF 1094-4087 Google Scholar
M. Azimipour, F. Atry and R. Pashaie,
“Calibration of digital optical phase conjugation setups based on orthonormal rectangular polynomials,”
Appl. Opt., 55
(11), 2873
–2880
(2016). https://doi.org/10.1364/AO.55.002873 APOPAI 0003-6935 Google Scholar
V. N. Mahajan and G. Dai,
“Orthonormal polynomials in wavefront analysis: analytical solution,”
J. Opt. Soc. Am. A, 24
(9), 2994
–3016
(2007). https://doi.org/10.1364/JOSAA.24.002994 JOAOD6 0740-3232 Google Scholar
Y. Shen et al.,
“Sub-Nyquist sampling boosts targeted light transport through opaque scattering media,”
Optica, 4
(1), 97
–102
(2017). https://doi.org/10.1364/OPTICA.4.000097 Google Scholar
Y. Shen et al.,
“Focusing light through biological tissue and tissue-mimicking phantoms up to 9.6 cm in thickness with digital optical phase conjugation,”
J. Biomed. Opt., 21
(8), 085001
(2016). https://doi.org/10.1117/1.JBO.21.8.085001 JBOPFO 1083-3668 Google Scholar
P. Lemaillet et al.,
“Correction of an adding-doubling inversion algorithm for the measurement of the optical parameters of turbid media,”
Biomed. Opt. Express, 9
(1), 55
–71
(2018). https://doi.org/10.1364/BOE.9.000055 BOEICL 2156-7085 Google Scholar
Y. Liu et al.,
“Focusing light inside dynamic scattering media with millisecond digital optical phase conjugation,”
Optica, 4
(2), 280
–288
(2017). https://doi.org/10.1364/OPTICA.4.000280 Google Scholar
BiographyJeeseong Hwang is a research biophysicist at Physical Measurement Laboratory of NIST, conducting research on measurement science for quantitative biophysics and optical medical imaging standards. Before NIST, he did research on nanoscale bio-imaging at the Johns Hopkins University jointly with the AT&T Bell Laboratories. Served in IEEE-Nanotechnology, SPIE BiOS, and ISO and received a US government silver medal for innovative nanotechnology tools and an award by the Washington Academy of Sciences. Lihong V. Wang is Bren professor of Medical and Electrical Engineering at Caltech. He has published 495 journal articles (h-index: 122, citations: 61,000), delivered 500 keynote/plenary/invited talks, and published the first functional photoacoustic CT and 3D photoacoustic microscopy. He received the Goodman Book Award, NIH Director’s Pioneer Award, OSA Mees Medal and Feld Award, IEEE Technical Achievement and Biomedical Engineering Awards, SPIE Chance Award, IPPA Senior Prize, and an honorary doctorate from Lund University, Sweden. He is a National Academy of Engineering member. |