Intraoperative laser speckle contrast imaging with retrospective motion correction for quantitative assessment of cerebral blood flow

. Although multiple intraoperative cerebral blood flow (CBF) monitoring techniques are currently available, a quantitative method that allows for continuous monitoring and that can be easily integrated into the surgical workflow is still needed. Laser speckle contrast imaging (LSCI) is an optical imaging technique with a high spatiotemporal resolution that has been recently demonstrated as feasible and effective for intraoperative monitoring of CBF during neurosurgical procedures. This study demonstrates the impact of retrospective motion correction on the quantitative analysis of intraoperatively acquired LSCI images. LSCI images were acquired through a surgical microscope during brain tumor resection procedures from 10 patients under baseline con-ditions and after a cortical stimulation in three of those patients. The patient ’ s electrocardiogram (ECG) was recorded during acquisition for postprocess correction of pulsatile artifacts. Automatic image registration was retrospectively performed to correct for tissue motion artifacts, and the performance of rigid and nonrigid trans-formations was compared. In baseline cases, the original images had 25% (cid:1) 27% noise across 16 regions of interest (ROIs). ECG filtering moderately reduced the noise to 20% (cid:1) 21% , while image registration resulted in a further noise reduction of 15% (cid:1) 4% . Combined ECG filtering and image registration significantly reduced the noise to 6 . 2% (cid:1) 2 . 6% ( p < 0 . 05 ). Using the combined motion correction, accuracy and sensitivity to small changes in CBF were improved in cortical stimulation cases. There was also excellent agreement between rigid and nonrigid registration methods (15/16 ROIs with < 3% difference). Results from this study demonstrate the

Intraoperative laser speckle contrast imaging with retrospective motion correction for quantitative assessment of cerebral blood flow Lisa  Abstract. Although multiple intraoperative cerebral blood flow (CBF) monitoring techniques are currently available, a quantitative method that allows for continuous monitoring and that can be easily integrated into the surgical workflow is still needed. Laser speckle contrast imaging (LSCI) is an optical imaging technique with a high spatiotemporal resolution that has been recently demonstrated as feasible and effective for intraoperative monitoring of CBF during neurosurgical procedures. This study demonstrates the impact of retrospective motion correction on the quantitative analysis of intraoperatively acquired LSCI images. LSCI images were acquired through a surgical microscope during brain tumor resection procedures from 10 patients under baseline conditions and after a cortical stimulation in three of those patients. The patient's electrocardiogram (ECG) was recorded during acquisition for postprocess correction of pulsatile artifacts. Automatic image registration was retrospectively performed to correct for tissue motion artifacts, and the performance of rigid and nonrigid transformations was compared. In baseline cases, the original images had 25% AE 27% noise across 16 regions of interest (ROIs). ECG filtering moderately reduced the noise to 20% AE 21%, while image registration resulted in a further noise reduction of 15% AE 4%. Combined ECG filtering and image registration significantly reduced the noise to 6.2% AE 2.6% (p < 0.05). Using the combined motion correction, accuracy and sensitivity to small changes in CBF were improved in cortical stimulation cases. There was also excellent agreement between rigid and nonrigid registration methods (15/16 ROIs with <3% difference). Results from this study demonstrate the importance of motion correction for improved visualization of CBF changes in clinical LSCI images. © The Authors.

Introduction
Because the brain relies on a constant supply of cerebral blood flow (CBF), any prolonged reduction of CBF can greatly increase the patient's risk for irreversible ischemic brain injury. By monitoring CBF during neurosurgery, surgeons can be promptly warned about a reduction in blood flow, allowing quick intervention to minimize the risks of postoperative neurologic deficits. Several intraoperative monitoring tools have been developed and evaluated in recent years, including digital subtraction angiography, 1-3 electrophysiological monitoring, [4][5][6] thermal diffusion flowmetry, 7-9 microvascular Doppler sonography, [10][11][12] and indocyanine green angiography. [13][14][15][16] Recent reviews of these techniques during aneurysm clipping procedures concluded that none were completely reliable in all situations and that combining multiple techniques provided a more accurate picture of the hemodynamic state. 17,18 Optical flow measurement techniques based on dynamic light scattering have the potential to improve many of the shortcomings of the currently available methods. Laser speckle contrast imaging (LSCI) is an optical imaging technique that provides high spatiotemporal resolution and quantitative measurements of blood flow. 19,20 LSCI is a noncontact, noninvasive, full field, and real-time imaging technique that requires simple instrumentation, including a low-power laser diode, imaging optics, and a camera. Because a contrast agent is not required, imaging with LSCI can be repeatedly performed as needed or can be continuously performed to serve as a monitoring tool during intraoperative procedures.
LSCI has been widely studied in animal models, and has been recently investigated for clinical use during neurosurgery with promising results. Multiple studies have examined the utility of a commercial LSCI system during direct surgical revascularization, 21,22 awake functional mapping, 23 and cortical spreading depolarization after malignant stroke. 24 All of these studies demonstrate the feasibility and usefulness of LSCI as an intraoperative tool for monitoring changes in CBF. However, these studies have not addressed correction for physiological motion artifacts, which have a direct influence on the motion-sensitive LSCI images. In this paper, we demonstrate the impact of retrospective motion compensation on the accuracy of quantitative blood flow analysis from LSCI images intraoperatively acquired during a pilot clinical study (n ¼ 10). The goal of this analysis is to improve the visualization of small CBF changes in small tissue regions, which may otherwise be lost due to physiological noise.

Instrumentation
An overall view of the hardware requirements for LSCI is shown in Fig. 1(a), with dashed lines indicating how each component is integrated into the clinical instrument. A schematic of the adapted microscope (Zeiss OPMI Pentero, Carl Zeiss Meditec Inc., Oberkochen, Germany) is shown in Fig. 1(b), with a corresponding photograph shown in Fig. 1(c). A laser diode (λ ¼ 660 nm, P ¼ 120 mW, Thorlabs Inc., Newton, New Jersey) was incorporated into an add-on laser adapter (MM6 Micromanipulator, Carl Zeiss Meditec Inc.), which was attached to the bottom of the microscope head. The laser beam linearly travels through the adapter until it encounters a curved mirror, which directs the beam toward the cortex as shown in the laser adapter illustration of Fig. 1(a). The steering toggle on the laser adapter controls the angle of the mirror, which allows positioning of the beam on the tissue surface. The laser power was measured to be 28 mW∕cm 2 , which is far below the ANSI standard of 200 mW∕cm 2 for maximum permissible exposure to a visible laser beam. 25 A camera (Basler A602f, Basler Vision Technologies, Ahrensburg, Germany) was connected to one of the side viewing ports using a C-mount camera adapter (Carl Zeiss Meditec, Inc.). The camera used in this study had a sensor size of 656 × 491 pixels, a pixel size of 9.9 μm, and a frame rate of 100 images∕second. This camera could be easily switched out for a camera model with a higher resolution or speed in future studies. The imaging optics built into the microscope were used to focus the camera and zoom onto an area of interest on the tissue surface. For this study, the microscope was set for maximum zoom and the camera field of view was ∼2 × 1.5 cm, corresponding to ∼3× demagnification relative to the camera sensor. The microscope's depth of field for the settings used during image acquisition was measured to be ∼5.7 AE 0.6 mm. The hardware modifications to the microscope were attached prior to the start of the surgery and did not interfere with sterile draping or with normal use of the microscope, as shown in Fig. 1(d).

Intraoperative Procedure
All experiments were performed during brain tumor resection surgeries at the NeuroTexas Institute in St. David's Hospital, Austin, TX. The clinical study was approved by the Institutional Review Boards of the University of Texas at Austin and St. David's Hospital and written informed consent was obtained for all patients. A summary of the patient details for the pilot clinical study is shown in Table 1. Immediately prior to LSCI imaging, the surgeon positioned the microscope over the cortical area of interest, adjusted the focus and zoom, and flushed the tissue with sterile saline to reduce specular reflections. LSCI images were recorded for ∼10 − 15 min with a camera exposure time of 5.0 ms. The camera exposure signal and the patient's electrocardiogram (ECG) waveform were simultaneously recorded during image acquisition for retrospective cardiac cycle motion compensation. Baseline blood flow images were recorded for all patients, and in three cases, images were acquired before and after cortical stimulation with either bipolar cautery or the Ojemann cortical stimulator.

Image Analysis
The raw images recorded by the camera were converted into speckle contrast images using Eq. (1), where the spatial speckle contrast, K, is defined as the ratio of the standard deviation, σ s , to the mean intensity of pixels, hIi, in a 7 × 7 pixel region of the image. 26 Sliding this window throughout the raw image creates the full-field speckle contrast image. The spatial speckle contrast analysis quantifies the local spatial variance, or blurring, of the speckle pattern that results from the decorrelation of coherent light in the presence of blood flow. Representative raw and speckle contrast images from a clinical case are shown in Fig. 1(a). By incorporating rapid processing techniques 27 into the custom software used for image acquisition, the speckle contrast images were computed and displayed in real time for live visualization of CBF during the procedure. All images in the paper are displayed as speckle contrast images, since these represent an instantaneous map of blood flow. The remaining image analysis was performed in postprocessing after the completion of each clinical case. To provide a more quantitative measure of blood flow, the speckle contrast images were converted to correlation time, τ c , using Eq. (2), where x ¼ T∕τ c , T is the exposure time of the camera, τ c is the correlation time, and β is an instrumentation factor that depends on polarization, coherence effects, and speckle averaging. 28 For this study, β was assumed to be equal to 1, which affects the absolute value of τ c but does not affect computations of relative changes in blood flow. CBF was calculated as the flow relative to a baseline value, which is the ratio of an average baseline τ c value and the τ c values at all remaining time points. 29,30 The baseline was defined as the average τ c over ∼5 s at the start of acquisition for each region of interest (ROI) analyzed. For all plots in the paper, the deviation in CBF from the baseline is shown, %Δ, which makes it easy to visualize the change in flow relative to the baseline value.

Cardiac Filtering
To account for blood flow changes that occur during the cardiac cycle, an ad hoc ECG filter [31][32][33] was implemented to reduce fluctuations in recorded τ c values. Briefly, the actual time of each image was determined from the recorded camera exposure signal and the actual time of each heartbeat was determined from the ECG waveform. A "normalized time" was assigned to each image frame based on the relative time of the image between adjacent R peaks in the cardiac cycle. The measured τ c was plotted against the normalized time for the first 25 heartbeats and a large-window moving average filter was used to compute the ad hoc filter function. This filter was applied to the entire data set by subtracting the filter value for the corresponding normalized time and adding back the median τ c of the filter function. A small-window moving average filter (width ¼ 0.15 s) was used to reduce the noise in the filtered τ c result. This cardiac filtering helps to reduce the variation in τ c due to the cardiac cycle while retaining inherent variability due to physiological changes in flow. 31

Image Registration
Image registration was performed on the speckle contrast images using Elastix. 34 This program performs an automatic intensity-based image registration by adjusting the position of a moving image to match a fixed image using the transformation type, similarity measure, and optimization procedure specified by the user. The similarity measure was set to mutual information and the optimization procedure was set to adaptive stochastic gradient descent based on the registration performance. The transformation type was set to either translation transform for rigid registration or B-spline transform for nonrigid registration, and a comparison between the two transforms was performed. The x-and y-offsets needed for mapping each moving image back to the fixed image were output from Elastix in the translation transform parameter file. An overall total displacement was calculated for each registered image to assess the spatial shift between the original and registered images.

Clinical Study Overview
The speckle contrast images serve as blood flow maps, where red regions correspond to faster flow and blue regions correspond to slower flow. Figure 2 shows the camera field of view (FOV) recorded by the Zeiss built-in color camera under xenon lamp illumination along with corresponding registered speckle contrast images for two patients. The speckle contrast images were also thresholded to display only speckle contrast values less than 40% of the maximum (fastest flows) and were overlaid on top of the color photographs. These image sets show excellent alignment of the anatomical vasculature and the blood flow maps seen in the LSCI images, confirming the performance of the microscope-integrated LSCI system. The overlay image also highlights a major benefit of integrating LSCI into the surgical microscope: LSCI can provide blood flow maps for the tissue region in the microscope's FOV with the spatial resolution of the microscope.

Retrospective Motion Correction
The result of applying the ECG filtering procedure on original and registered image sets is shown for a single patient in Fig. 3, where the measured τ c has been converted into CBF %Δ for ease of interpretation. Figure 3 shows the alignment of the minimum CBF with the ECG R-peak [ Fig. 3 Translation rigid registration was performed for all image data because of the decreased complexity, reduced computation time, and preservation of image integrity. A comparison between the original and registered image sets is shown for three baseline cases in Fig. 4. These plots illustrate greater stability and reduced fluctuations in the ROI time courses after registration, especially for the vessel ROIs. This confirms that the CBF changes in the original time courses were solely due to tissue motion, causing vessel ROIs to sample the parenchyma, and vice versa. Compared to the dramatic improvement for vessel ROIs, registered parenchyma ROIs are visually similar to their originals, especially those placed farther from nearby vessels. A movie showing the original and translation-registered image sets for a single baseline case is included to demonstrate the effectiveness of image registration for correcting tissue motion artifacts in LSCI images (Video 1, left and center panels).
As seen in the left frame of Video 1 and in the original plots from Fig. 4, the lateral displacement caused by tissue motion can be a significant source of noise, especially for vessel tissue regions. This displacement was quantified as the total spatial shift of each registered image relative to the fixed image at the start of acquisition. Across seven cases, the mean lateral displacement ranged from 0.12 AE 0.078 to 0.64 AE 0.15 mm, and the maximum displacement ranged from 0.41 to 1.9 mm. To illustrate how tissue motion affects the measured CBF changes, the relationship between the change in τ c and displacement is illustrated in Fig. 5 for two cases corresponding to  Quantitative analysis confirms that both vessel and parenchyma regions had a statistically significant noise reduction after ECG filtering plus registration (Fig. 6). Noise was quantified as the standard deviation of the CBF % over the recorded time course for each ROI analyzed. Noise levels were compared for the original recorded images versus ECG filtering alone, image registration alone, and ECG filtering plus image registration for 16 ROIs across four baseline cases. ECG filtering alone as well as combined with image registration are the two scenarios highlighted in the plots from Fig. 4. As shown in Fig. 6, ECG filtering alone causes a statistically significant noise reduction in the parenchyma regions (15% AE 3% to 8.3% AE 2.7%, p < 10 −5 ). Registration alone causes a statistically significant noise reduction in the vessel regions relative to ECG filtering alone (38% AE 25% to 16% AE 5.8%, p < 0.05), as well as a large reduction relative to the vessel noise in the original set. However, the most dramatic noise reduction is seen after combining both ECG filtering and image registration, which had a statistically significant reduction for all tissue regions. Combined ECG filtering and image registration significantly reduced the noise across all ROIs to 6.2% AE 2.6%. This was statistically significant compared to the original set (25% AE 27%, p < 0.05), ECG filtering alone (20% AE 21%, p < 0.05), and image registration alone (15% AE 4%, p< 10 −5 ). For the three cortical stimulation cases, a comparison between the original and registered images is shown in Fig. 7. Similar to the original baseline cases, large-scale fluctuations resulting from tissue motion make it difficult to accurately quantify and interpret the flow dynamics, especially in Figs. 7(b) and 7(e). After registration, the noise is largely  Since brain tissue may deform after skull removal, a nonrigid transform may be required to account for tissue deformation. Because of increased computational costs, we performed B-spline nonrigid registration on a subset of the pilot study data from four baseline patients for comparison to the translation transform, with results shown for a single patient in Fig. 8. the effectiveness of nonrigid image registration for correcting axial tissue deformation artifacts in the LSCI image set.
Quantitatively, the average percent difference between rigid and nonrigid registration methods is displayed in Table 2 for the ROIs shown in Figs. 4(a), 4(d), 4(g), and 8(a). Although Bspline registration is effective for removing residual nonrigid tissue deformation artifacts that occur in the axial direction, the difference compared to translation registration was minimal, with <1% difference for 11/16 ROIs and <3% difference for 15/16 ROIs. Region 4 in Fig. 8(a) had the largest discrepancy with a 7% difference. However, the improvement of B-spline registration was only moderate relative to translation registration when viewing region 4 over time. Overall, the lower complexity translation registration had excellent agreement with B-spline registration and the improved motion correction indicated by the small percent differences would not change the course of treatment.

Discussion
Many groups have demonstrated the feasibility of using LSCI as an intraoperative monitoring tool. [21][22][23][24][31][32][33] As LSCI gains popularity and clinical investigations increase, it is important to assess the impact of physiological motion and investigate methods to compensate for these artifacts. Because LSCI is inherently sensitive to motion, the recorded images are impacted by both pulsatile flow and tissue deformation from the cardiac cycle and respiration. This paper utilized the ECG filtering method 31 to reduce the beat-to-beat variability from 12% to 3%, making it possible to visualize small changes in the flow. LSCI has the potential to be used as a monitoring tool during functional activation procedures such as awake cranial mapping, where the change in blood flow may be as low as 5% to 10%. 35 Pulsatile changes in flow can mask these small changes, making ECG filtering crucial for increasing applicability of the technique to a wide range of neurosurgical procedures. Although other techniques could be used for cardiac filtering, there are disadvantages associated with each. A large-window moving average filter alone (width ¼ 0.5) can be used to reduce the beat-tobeat variability from 12% to 2.8%; however, the ability to observe transient physiological blood flow changes is diminished. 31 Alternatively, the image acquisition can be synchronized with the cardiac cycle to minimize both the cardiac shift and the CBF measurement error. However, gating the signal during acquisition will reduce the effective frame rate by 24% to retain data AE10% from baseline and by 63% to retain data AE5% from baseline. This will reduce both the continuity of the data and the ability to perform frame averaging.
Image registration was added to improve the ability to track tissue ROIs accurately over time with significant noise reduction. The image registration method used in this study employs a similar procedure to a reported rodent study, 36 which found significant spatial de-noising after registration. The flow dynamics are easier to interpret and quantify compared to the original time courses, especially for vessel regions and parenchyma regions placed near a vessel. The lateral displacement caused by tissue motion was quantified, ranging from a maximum of 0.41 to 1.91 mm across cases with excellent correspondence to the change in flow measured by LSCI. Noise reduction was quantified across 16 ROIs of different tissue types, with ECG filtering alone leading to a significant noise reduction in the parenchyma regions and image registration alone leading to the largest noise reduction in the vessel regions. These motion correction techniques could be individually used if the imaging application focused on only certain tissue types. By combining ECG filtering and image registration, noise levels were significantly reduced across all ROIs to 6.2% AE 2.6%, which makes it possible to visualize small changes in the flow from any tissue region. The motion correction techniques improved visualization of stable CBF levels during baseline cases and relative changes in blood flow after cortical stimulation, with a measured flow reduction as small as 24%. Although LSCI can only provide relative flow information, the ability to identify change in blood flow is clinically most important. LSCI provides both the relative magnitude and the temporal dynamics of the blood flow change with the help of motion correction, which is the information the surgeon needs for clinical decision making. Although translation-based image registration is computationally intensive, combined ECG filtering and image registration provides the highest level of noise reduction, allowing visualization of blood flow changes. The results from this study suggest that intraoperative implementation of motion compensation techniques will increase the value and efficacy of LSCI as a CBF monitoring tool.
Correction for axial displacement was also examined using B-spline nonrigid registration. ROI analysis for B-spline registration was comparable to translation registration (<3% difference across 15/16 ROIs), confirming that translation registration is sufficient for motion correction to reduce the computational costs. Although depth correction was unnecessary for accurate quantitative analysis, it is important that the images remain in focus throughout the full range of axial displacement observed to ensure accurate CBF estimates from LSCI. Given the microscope's measured depth of field, the maximum axial range must be ≤5.1 mm to maintain the focus during acquisition. As seen easily in Video 1, the pulsatile motion of the brain during the cardiac cycle results in axial motion. The axial displacement of the brain during the cardiac cycle has been measured to be up to 2 mm, 37 which is still well within the microscope's depth of field. The curvature of the brain can also affect the axial range of the image. For the three-dimensional cortical surface of the brain, the large-scale curvature can be estimated using the mean geodesic of the brain, which corresponds to a 64-mm radius osculating sphere. 38 This corresponds to an axial range of 1.2 mm for the ∼2 × 1.5 cm FOV, which is still well within the depth of field. The local curvature of the cortex p < 0.05 p < 10 -5 ** vs. Orig. ** vs. ECG ** vs. Reg. Fig. 6 Quantification of noise (standard deviation of CBF %) before and after both ECG filtering and image registration across ROI groups from baseline cases 1, 5, 7, and 9. Statistical significance is calculated using a right-tailed paired t -test. Sample sizes are N ¼ 6 for vessel ROIs, N ¼ 10 for parenchyma ROIs, and N ¼ 16 for all ROIs. Orig. = original data set; ECG = ECG filtering only; Reg. = image registration only; and Both = ECG filtering plus image registration. ranges from flat up to a 15-mm radius sphere at the sulci. 39 Because all images were recorded within the cortical gyri, where the osculating sphere radius should be much larger, we expect the remaining axial range of 3.1 mm after cardiac displacement to be sufficient for this study.
Other groups who have tested LSCI intraoperatively [21][22][23][24] have not investigated the impact of motion compensation, which may be due to inherent differences in the instrumentation. Compared to the commercial LSCI system used in those studies, we integrated the LSCI hardware into the neurosurgical microscope. This had many benefits, including improving the surgical workflow, reducing the setup time for imaging, and increasing the surgeon's familiarity with the instrument. The relatively small FOV in our study made tissue motion compensation more critical, since smaller pixel resolution results in a larger relative tissue displacement in the images. Although not as sensitive to motion, large FOV images can also benefit from motion compensation. Another difference was the 4× faster frame rate  Fig. 7 A comparison between the time courses of ROIs before and after translation-based image registration for three cases with cortical stimulation, patients 4, 6, and 10 for parts (a)-(c), (d)-(f), and (g)-(i), respectively. The images on the left (a, d, g) display the speckle contrast image at the start of image acquisition averaged over 30 frames with a field of view of ∼2 × 1.5 cm [same scale bar from Fig. 2(a)]. The color map displays high flows in red (low speckle contrast) and low flows in blue (high speckle contrast) with five numbered ROIs overlaid in black where analysis is taking place. The dotted black oval indicates the location of stimulation in the field of view, and the yellow star indicates the time that the stimulation occurred. In (a) and (g), bipolar cautery was used with forceps close together (one oval). In (d), the Ojemann cortical stimulator was used, and the two ovals show the locations of both bipolar stimulators. The middle column of plots (b, e, h) displays the time course of the original recorded CBF percent change (%Δ) during the course of the intraoperative acquisition. The right column of plots (c, f, i) displays the time course of the CBF %Δ after translation-based image registration of the image set. The CBF %Δ is calculated using an average of ∼5 s of baseline flow before stimulation occurs. Plots for the same patient were plotted with the same axes for easier comparison before and after registration.
of the camera used in this study. 24 At rapid image acquisition, the camera more accurately captures the inherent physiological motion, which is why both cardiac and tissue motion correction significantly reduced CBF fluctuations in this study. The faster frame rate camera is beneficial because it allows more averaging of the acquired images, which improves the signal-to-noise ratio (SNR) in the image and ROI analysis. In this study, we performed averaging in the form of a moving average filter in postprocessing. For real-time display, five-frame averaging could be performed to improve the SNR, resulting in an effective frame rate of 20 images∕second. As microscope-integrated LSCI becomes more widely adopted and as camera frame rates continue to increase, motion compensation will only increase in importance.

Conclusion
The results from this 10-patient pilot clinical study are promising and demonstrate that retrospective motion correction techniques can dramatically improve the accuracy for quantitatively monitoring relative blood flow over time. This is important for magnified imaging with high spatiotemporal resolution using a microscope-integrated LSCI system, and allows detection of blood flow changes after cortical stimulation. LSCI has the potential to be a valuable intraoperative monitoring tool for a variety of neurosurgical procedures, and should be further studied with real-time motion correction for possible addition to the current collection of available monitoring options.