## 1.

## Introduction

Optical coherence tomography (OCT) is a powerful imaging technique with important applications in several fields. It is, for instance, used in the analysis of biological samples by obtaining high-resolution cross-sectional backscattering profiles.^{1} OCT has also been used in several medical applications, mainly ophthalmology, dermatology, and urology.^{2} In ophthalmology, OCT scanning of the retina aims at the analysis of the different morphological layers, which contain important structures for the diagnosis of pathological situations. Recent research activities showed that OCT also possesses a strong potential for displaying brain morphology.^{3} In this context, OCT imaging aims at providing the surgeon with information at the microscale level, intraoperatively. Applications include the identification of residual tumor tissue or white matter fibers that can be integrated into the navigation environment, such as a microscope, by means of virtual reality.

A crucial role for automated information extraction in medical imaging, such as OCT, usually involves the segmentation of areas of the image for, e.g., quantification of tissue volumes, diagnosis, and localization of pathologies. Image segmentation itself is an ongoing issue in medical image-processing research. Numerous approaches regarding medical image segmentation have evolved in the past and can be classified into eight major categories (see Ref. 4): (*i*) thresholding, (*ii*) region-growing approaches, (*iii*) classifiers, (*iv*) clustering approaches, (*v*) Markov random field models, (*vi*) artificial neural networks, (*vii*) reformable models, and (*viii*) atlas-guided approaches. Their advantages and disadvantages are discussed in Ref. 4. A common approach to segmentation is the above-mentioned region-growing approach (RGA). The goal is to use image characteristics to map individual pixels in an input image to sets of pixels called regions, usually with common properties. Commonly, region growing methods start at the location of a seed and growing is governed by a homogeneity criterion. These criteria can be based on the intensity information and/or edges in the image.^{5} General drawbacks of region growing are its user dependency by manual seed placement, sensitivity to changes in the seed’s location, leakage, and the difference in the nature of the data to be analyzed.

Segmentation of OCT images has been investigated in limited fields. Primarily in ophthalmology, several approaches have been developed for the segmentation and identification of retinal layers.^{6, 7, 8} In other fields, such as dermatology, Hori and Yasuno^{9} developed a method for automatic segmentation of different structures in the human skin. In Ref. 10, a method for the segmentation of cartilage images from OCT is presented. It is important to note that the former examples focus on images with certain characteristics and do not feature OCT data segmentation in a more general sense.

The segmentation of OCT images generally faces two major problems. First, the intensity course in OCT images results from absorption and scattering of light in tissue. Thus, intensity of a homogeneous area decreases with increasing imaging depth deterministically. This complicates common segmentation approaches, which are usually based on the assumption that intensity variations of homogeneous regions are only due to noise and not inherent to the imaging modality. The second problem is that OCT images are subject to speckle noise, which decreases the image quality and complicates the image analysis.

The latter problem has been targeted by the development of many image-processing methods for enhancement by the means of speckle-noise reduction (see Ref. 11 for an overview). Related techniques originate in the synthetic aperture radar (SAR) community and have been also applied to the field of ultrasonic imaging. To date, commonly applied filters for speckle removal in SAR and ultrasonic images include the Lee,^{12} the Frost,^{13} and the Kuan filter.^{14} The disadvantages of these filters are the output dependency on the size and the shape of the respective filter kernel and the inability to enhance edges that could destroy important information. These drawbacks have led to the development of edge-sensitive or enhancing filters. Some of these filters are based on the solution of a diffusion equation derived from the heat equation and are also known as partial differential equation (PDE)-based anisotropic filters. This approach was first introduced by Perona and Malik and led to the so-called Perona–Malik filter.^{15} Generally, these filters encourage smoothing along, while prohibiting smoothing across edges.^{15, 16} In Ref. 17, the PDE-based formulation is extended to a nonlinear complex diffusion process with a complex valued diffusion coefficient. In recent work on OCT imaging, these two different filtering approaches for OCT images are compared.^{18}

Despite the advantage that edge-sensitive filtering enhances the suitability of common RGAs, filtering also alters the image in a way that important information may not enter the segmentation step. On the other hand, if segmentation is performed on unfiltered data, common homogeneity criteria tend to fail because of speckle-noise corruption.

In this work, we propose two approaches to automated seeded region growing for the segmentation of OCT images. Automation of the algorithm is provided by a model-based seed-detection algorithm, which analyzes the intensity profile of an A-scan. Thus, the user dependency is reduced significantly compared to a manual seed selection. In both approaches, the seed detection is followed by a region-growing algorithm. The first approach applies an adaptive neighborhood homogeneity criterion within unfiltered OCT images while the other is based on edge-sensitive filtered images. The ultimate goal of both algorithms is to automatically locate specific structures in OCT images in order to facilitate the usage in diagnosis and/or extraction of morphological information. The information could, for instance, be used for medical navigation, where OCT information is acquired from the probe tip directly and correlated to existing morphological data (e.g., computer tomography data).

The approach is illustrated for the detection and identification of white matter fibers, a valuable application for neurosurgical navigation, where the integration of a real-time imaging modality, such as OCT can provide important information intraoperatively. We also present the application and results for the segmentation of low and highly scattering structures in multiple OCT images, indicating the generality of the proposed approach.

## 2.

## Materials and Methods

Both segmentation approaches consist of two steps. The first step, which is common to both algorithms, performs an automated, model-based seed detection. This step forms the basis for the automatic characteristic of the approach. Changes of tissue characteristics are detected by analyzing the intensity profiles that are given by the columns of a B-scan image (A-scans). The detected seeds are used for a region-growing method forming the second step. Two approaches for the region growing featuring different growing criteria are introduced as follows:

1. An adaptive neighborhood region growing (ARG).

2. A filtered-image region growing (FRG) approach based on a edge-sensitive filtered version of the original OCT image.

## 2.1.

### OCT and Speckle-Noise Modeling

OCT is based on the principle of interferometry. The resulting waveform is the sum of the light waves from reference path and sample path. Because being used for imaging purposes in medical applications, analytical models of OCT systems have been developed in order to extract optical properties of tissue to support diagnosis. Different approaches have been proposed. The most advanced models incorporate the multiple-scattering contribution to the OCT signal. Two models are used for extraction of tissue parameters: the radiative transport model^{19} and the extended Huygens–Fresnel model.^{20} Their analytical expression is divided into three terms, one term representing the single-scattering contribution, another term representing the contribution of multiple-scattering, and the last term denoting the cross relation. See Ref. 20 for a detailed explanation. Turchin
^{21} derive a theoretical model of the OCT signal for layered media, which integrates small-angle scattering at low depths as well as light diffusion at large depths. The nonlinear model consists of a set of unknown parameters, which are subsequently optimized by a genetic algorithm to fit a measured A-scan profile. Thus, different tissue characteristics can be determined.

In this work, a simplified OCT model based on the single-scattering effect will only be used. Although it does not account for all effects of light propagating through tissue, such as multiple scattering, the simplified model allows linear modeling of the OCT intensity signal. Thus, linear filter theory can be applied and will be done throughout this work. In Ref. 22, the authors propose a model where the measured intensity is proportional to an exponential decay

where ${I}_{0}$ is the initial intensity and $\mu $ denotes the scattering coefficient, and $z$ the scanning depth. In brain imaging, the results in Ref. 23 show that $\mu $ differs for various tissue structures (e.g., cortex, external capsule) allowing a clear distinction of white and gray matter. This fact motivates the use of the simplified model for OCT analysis despite its theoretical shortcomings.In addition to modeling the intensity, speckle noise corrupting OCT images can be modeled statistically. It is usually assumed to be a multiplicative random noise. If $f$ denotes the ideal image and $g$ the speckled image, this assumption can be expressed as

where $u$ is a signal-independent random variable whose probability density function (PDF) depends on the image type.^{12, 24}Commonly, the speckle PDF is assumed to follow an exponential distribution described by

In the following, two contributions to the local intensity at a depth $z$ in an OCT image will be considered:

1. Deterministic contribution. The deterministic part at a depth $z+\Delta z$ evolves from Eq. 1 and can be formulated as

2. Statistical noise contribution. The stochastic noise contribution at depth $z$ will be accounted for according to Eqs. 3, 4. This means that noise corruption is proportional to the local gray value $I\left(z\right)$ at depth $z$ .

## 2.2.

### Automated Seed Detection

A basic requirement for region growing methods is the specification of seeds, which serve as a starting point for an iterative growing process. A fundamental adept of the proposed method is the automated acquisition of the seeds, derived from an A-scan analysis. An OCT A-scan is a one-dimensional intensity profile over the depth of the scanned sample. The method relies on the simplified model of OCT intensity stated in Eq. 1 and the statistical nature of speckle noise. In a first step, the A-scan course is linearized by applying the natural logarithm operator to Eq. 1

## Eq. 6

$\mathrm{ln}\left[I\left(z\right)\right]=\mathrm{ln}\left({I}_{o}\right)-2\mu z={\stackrel{\u0303}{I}}_{o}+mz.$Automated detection of seeds is exemplary elaborated for white matter detection in OCT images. A good indication of white matter areas in A-scans is based on the high optical contrast of a white matter structure which manifests itself as a sudden increase (spike) in intensity (see Fig. 2 ). The detection of the spike location can therefore be used as an indicator for white matter areas. Calculating the first derivative of the A-scan intensity course and simple thresholding provides the location of potential white matter regions. A spike at ${z}_{k}$ is detected if

The corresponding threshold ${\sigma}_{1}$ is based on gray values per pixel difference. Analyzing the first derivative of the intensity according to Eq. 8 provides a set of white matter–induced peak candidates (see Fig. 2). The signal, however, is also corrupted by speckle noise severely distorting the signal quality. Similar to changes caused by white matter, speckle noise also introduces a spiking characteristic to the intensity signal. This complicates the white matter detection in OCT A-scans, and a robust classification of white matter has to be designed. To differentiate white matter peaks from speckle-noise–induced peaks, two cases can be analyzed. Assume a homogeneous area with the intensity $f$ . Speckle noise introduces spikes in two ways, as follows:1. Speckle related spikes results in an intensity increase. Referring to Eq. 2, this corresponds to the case where $u>1$ .

2. Speckle results into a sudden decrease of intensity $(u\u2aa11)$ , which is then followed by a sudden increase to the ideal intensity $f$ , which would subsequently be detected as a peak candidate.

1. Assume an intensity spike because of $u>1$ at the location ${z}_{k}$ is introduced by speckle noise. Because speckle noise features random characteristics, the intensity at pixels following the spike most probably drop again. White matter areas, however, will show a slow increase with a characteristic slope [see Eq. 7]. Therefore, white matter can be classified if the ratio

Here, ${\sigma}_{2}$ denotes a slope-related threshold and ${l}_{T}$ the length of the white matter tail.## Eq. 9

$\frac{\stackrel{\u0303}{I}({z}_{k}+n)}{\stackrel{\u0303}{I}({z}_{k}+n-1)}>{\sigma}_{2}\phantom{\rule{1em}{0ex}}\text{for}\phantom{\rule{1em}{0ex}}n=[1\dots {l}_{T}].$2. For speckle related spikes according to the second scenario $u\u2aa11$ , an additional measure is introduced. It relates the intensity at the detected spike location ${z}_{k}$ to the mean of intensities previous to the spike location. A white matter–related spike is detected if

Here, $N$ denotes the number of pixel locations previous to the spike, which will be taken into account.## Eq. 10

$\frac{\stackrel{\u0303}{I}\left({z}_{k}\right)}{\left[{\sum}_{n=1}^{N}\stackrel{\u0303}{I}({z}_{k}-n)\right]\u2215N}>{\sigma}_{3}.$

After having identified seed candidates in the OCT A-scan, a third robustness measure, called a low-consistency check, is introduced. The location of detected seeds is compared to the location of detected seeds in the neighboring A-scans. Therefore, a $5\times 5$ window with its center being the current seed is analyzed. If this window contains more than four additional seeds, then the current seed is approved.

Performance of the proposed seed detection scheme is strongly dependent on the threshold parameters ${\sigma}_{1}$ , ${\sigma}_{2}$ , and ${\sigma}_{3}$ . Heuristics for the choice of the thresholds and the overall performance evaluation is based on an extensive analysis of simulated B-scans (see Sec. 3.2). The proposed seed-detection algorithm is now summarized in the following definition.

**Definition 1**. *Let*
$I$
*denote an image. Then*,

*is defined as the set of seed pixels provided by the A-scan intensity course based white matter detection*.

## 2.3.

### Adaptive Neighborhood Region Growing (ARG)

Common region growing approaches tend to fail in OCT images because of the exponential decay according to Eq. 1 and the speckle-noise corruption. This is because the OCT signal properties and the dependency of the noise on the local intensity is not reflected by the homogeneity criteria used in those methods. Resulting from research in the image-filtering community, adaptive filters have been developed that estimate the speckle standard deviation
${\sigma}_{u}$
based on the local mean.^{24} The approach has proven to be well suited for filtering of SAR images. For OCT images, however, this approach is not optimal as the intensity level follows a deterministic behavior as shown in Eq. 1. To perform region growing based on adaptive neighborhood filtering, the approach will be extended by incorporating the OCT intensity model into the homogeneity criterion. The approach is based on the following ideas:

1. The homogeneity or growing criterion for OCT images will be affected by two parts: a deterministic part incorporating the modeled behavior as in Eq. 1 and a stochastic part based on the local average and standard deviation.

2. The speckle-noise standard deviation ${\sigma}_{{g}_{\mathrm{hom}}}$ is not known

*a priori*and will be estimated within a local neighborhood according to Eq. 4 (as proposed in Ref. 24).

**Definition 2**. *Let*
$s$
*denote a pixel of a speckle noise corrupted image*
$g$
. *Then*
${\Gamma}_{n}\left(s\right)$
*denotes the*
$n\times n$
*neighborhood of*
$s$
*and*
${\Gamma}_{n,y}\left(s\right)$
*denotes the*
$n\times 1$
*rowwise neighborhood in the row*
$y$
*(neighboring pixels in the same row)*.

**Definition 3**. *Let*
$s$
*denote a pixel of a speckle noise corrupted image*
$g$
*and*
$g\left(s\right)$
*the gray value at pixel*
$s$
. *Let*
$q$
*be a pixel and element of*
${\Gamma}_{n}\left(s\right)$
. *The confidence interval*
$[{T}_{1},{T}_{2}]$
*for*
$q$
*determines the range of valid*
$g\left(q\right)$
*values for it to become part of the current region and is given by*

## 12.

*where*${c}_{1}$

*and*${c}_{2}$

*are confidence interval shift parameters and*

*where*${s}_{z}$

*and*${q}_{z}$

*denote the*$z$ -

*coordinate of the pixel, which corresponds to the imaging depth and*$\Delta z$

*their depth difference. The adaptive region growing homogeneity criterion is then defined as*

1. Obtain an initial seed set $S$ by performing the seed detection.

2. Estimate the local average ${\overline{g}}_{\mathrm{hom}}$ as the row-wise median ${\Gamma}_{n,y}\left(s\right)$ within the row of the seed pixel $s$ .

3. For every pixel $q$ in a $3\times 3$ neighborhood of a seed pixel $s$ , calculate the confidence interval according to Eq. 12 and evaluate the membership to the region according to the homogeneity criterion.

4. If membership is given, meaning the homogeneity criterion is fulfilled, include the neighbor pixel $q$ into the seed set $S$ and the set of detected white matter $R$ .

5. Stop the region growing if the seed set $S$ is empty.

## 2.4.

### FRG

As stated in Sec. 1, numerous noise-removal techniques have been developed for the reduction of speckle-noise corruption. Filters that do not support edge preservation are generally not suitable for RGA. Edge-sensitive or enhancing filters, however, try to smooth along edges and not across them, thus being good candidate filters for subsequent region growing approaches. The review of recent OCT-related literature^{18} shows that the Perona–Malik and the complex diffusion filter are suitable approaches for OCT image filtering. Although the Perona–Malik serves primarily as a edge-preserving denoising process,^{15} the complex diffusion filter performs even better denoising image, also avoiding staircasing,^{17} which can be an additional source of artifacts. For the rest of this work, the following definitions will be used:

**Definition 4**. *Let*
$I$
*denote a gray-valued image. Then*,

*is defined as the edge-sensitive filtered version of*$g$

*according to Ref. 15*.

In this formulation, $N$ denotes the number of iterations and $K$ denotes the edge threshold parameter. In Ref. 17, the concept is extended to a complex diffusion process.

**Definition 5**. *Let*
$I$
*denote a gray-valued image. Then*,

*is defined as the complex diffusion filtered version of*$g$

*according to Ref. 17*.

Filtering according to both approaches incorporates the following features:

Region growing for the filtered version of the image follows the same guidelines as the ARG approach except that the homogeneity criterion is chosen differently. This is because the intensity distribution in the image is altered and the effect of speckle noise is reduced through the filtering process. In fact, the criterion can now be selected as a simple, intensity-based criterion employing the median operator.
**Definition 6**. *Let*
$s$
*denote a pixel of a speckle noise corrupted image*
$g$
*and*
$\widehat{g}$
*the filtered version. Let*
$\widehat{g}\left(s\right)$
*denote the gray value at pixel*
$s$
. *Let*
$q\u220a{\Gamma}_{n}\left(s\right)$
. *Then, the confidence interval*
$[{T}_{1},{T}_{2}]$
*at*
$q$
*is given by*

## 15.

*where*${c}_{1}$

*and*${c}_{2}$

*are confidence interval shift parameters. The filtered region growing homogeneity criterion is then defined as*

## 3.

## Results

## 3.1.

### Simulated B-Scan

Performance evaluation of both segmentation approaches is achieved through the simulation of white matter fibers in artificial B-Scans. Hereby, an artificial B-scan is composed of a fixed number of artificial A-scans, which are generated according to the intensity model shown in Eq. 1. Two tissue structures, namely, white and gray brain matter, are incorporated by using different scattering coefficients ${\mu}_{\mathrm{WM}}$ and ${\mu}_{\mathrm{GM}}$ respectively. Generally, the basic decay with increasing depth is assumed to be governed by gray-matter scattering. At random depth locations, white matter areas are introduced by two means, as follows:

1. intensity increase

2. change of scattering coefficient ${\mu}_{\mathrm{GM}}\to {\mu}_{\mathrm{WM}}$

**Definition 7**. *Let*
$g$
*denote a gray-valued image. Let*
${p}_{{q}_{z-1}}$
*and*
${p}_{{q}_{z}}$
*denote neighboring pixels in one column and let*
${p}_{{q}_{z-1}}$
*be an element of a gray matter area and*
${p}_{{q}_{z}}$
*be an element of white matter area. Then*,

*is defined as the PCR of white and gray matter areas*.

The size of the white matter region can also be chosen randomly. After generating the ideal intensity course, signals were contaminated with artificial multiplicative noise under the model of

where $u\left(n\right)$ is a stationary noise process which has mean 1 and variance ${\sigma}_{u}^{2}$ .Figure 4 visualizes the concept. To each image, a fixed number of fibers was added. Size and location of the fibers were randomly chosen. This way, the simulation reproduced an approximate behavior of the presence of white matter fibers in brain tissue. In Fig. 5, the artificial B-scan and the embedded fibers are shown.

## 3.2.

### Seed Detection

The seed detection algorithm presented in Sec. 2.2 was evaluated in order to find the optimal set of parameters ${\sigma}_{1}$ , ${\sigma}_{2}$ , and ${\sigma}_{3}$ for different PCR of structures in the image. Therefore, artificial B-scans as described in Sec. 3.1 were created and a measure for the seed-detection performance was evaluated for different parameters ${\sigma}_{1}$ , ${\sigma}_{2}$ , and ${\sigma}_{3}$ . Performance evaluation is based on the following two measures:

1. Percentage of detected white matter structures. The percentage of detected white matter structures can be understood as the sensitivity of the seed-detection process. It indicates how many structures (not pixels) are identified by at least one seed and will therefore enter the region-growing process.

2. Number of false positive seeds. The seed detection related false positive ratio gives the percentage of false positive seeds against the total number of detected seeds.

1. The choice of ${\sigma}_{2}=1.25$ outperforms other parameter settings in terms of the false positive and the percentage of detected structures.

2. The choice of ${\sigma}_{1}=40$ yields the best results. This parameter choice is also supported for other PCR scenarios ( $\mathrm{PCR}=20$ and $\mathrm{PCR}=30$ ).

3. The choice of ${\sigma}_{3}$ can be seen as a trade-off between the percentage of detected structure and the false-positive rate. A choice of ${\sigma}_{3}=0.5$ yields a better sensitivity for white matter structure detection but a higher false-positive rate. The higher ${\sigma}_{3}$ , the lower the sensitivity and the false positive detected seeds. This leads to a choice of ${\sigma}_{3}=[0.5\dots 0.7]$ .

## Table 1

Averaged seed-detection performance for varying PCR for n=100 of simulated B-scans.

PCR | % of detected white matter structures | % of false positive detected seeds |
---|---|---|

20 | 0.91 | 0.07 |

25 | 0.95 | 0.04 |

30 | 0.98 | 0.02 |

40 | 0.98 | 0.007 |

50 | 0.98 | 0.001 |

## 3.3.

### Segmentation Performance Measures

The performance measures for both RGAs (ARG, FRG) were chosen as follows:

1. The Jaccard (JC) index.

where $X$ is a set of segmented pixels in the image to be evaluated and $Y$ is the set of segmented pixels in the reference image (desired segmentation). The operator ∥ stands for the number of elements. This similarity measure is equal to 1 if $X$ and $Y$ are the same region and zero if they are disjoint regions.^{26}It is given as2. The Hausdorff distance (HD).

^{27}The HD defines the largest difference between two contours and is a well-accepted measure for leakage.3. Time. All results were obtained on a PC with $2.4\text{-}\mathrm{GHz}$ processing unit and $2\phantom{\rule{0.3em}{0ex}}\mathrm{GB}$ of RAM.

## 3.4.

### Simulation Results

Automated white matter detection was evaluated on $n=100$ test images with $400\times 512\phantom{\rule{0.3em}{0ex}}\text{pixels}$ . Twenty white matter regions with random location and random size were simulated in the test images. The images were subsequently corrupted by speckle noise following an exponential PDF, as shown in Eq. 3. The standard deviation of the noise was chosen to be ${\sigma}_{u}=1$ . Different peak contrast ratios were analyzed.

Segmentation results of both, ARG and FRG approaches with edge-sensitive filtering, are dependent on certain parameters. To derive an adequate choice of parameters, different parameter settings were analyzed with respect to the JC index and the HD.

## 3.4.1.

#### ARG parameters

In the ARG scenario, the parameters to be varied are the scattering coefficient ${m}^{\prime}$ and the confidence interval shift parameters ${c}_{1}$ and ${c}_{2}$ . In Fig. 6, the JC index and HD are shown for different PCRs and parameter sets. The following observations can be made: generally, the higher the JC index is, the higher the HD is, which requires the user to find a trade-off between segmentation quality and leakage. For all PCR scenarios, the following effect of the confidence shift parameter can be observed: a low shift parameter (e.g., ${c}_{1}=0.90$ ) leads to a small JC index and a low HD. A high shift parameter (e.g., ${c}_{1}=0.99$ ) also leads to a small JC index but a higher HD. The optimum value of the shift parameter is therefore in the range ${c}_{1}=0.93\dots 0.97$ .

Observing the simulated segmented images and the changes induced by different values of shift paramenter ${c}_{1}$ , it was noted that the ratio of correctly identified white matter pixels over the number of existing white matter pixels, as well as the ratio of falsely identified white matter pixels over the number of existing white matter pixels, decreased as the ${c}_{1}$ parameter increased. This indicates that a lower interval shift parameter imposes less constraints on the growing process and therefore identifies more structures of interest but results in a higher false positive rate. For a high interval shift parameter ${c}_{1}=0.99$ , the ARG identifies only a small subpart of the white matter structures which leads to the low JC index. Interestingly, the HD is still high. This is due to the fact that the largest difference between the two contours is not due to leakage but due to the difference of the true contour to the much stricter segmented version. Extensive simulations have shown that the parameter ${c}_{2}$ does not influence the results in the white matter–detection scenario significantly. This is because seeds are already located in high-intensity areas. Leakage mostly occurs if the lower bound of the confidence interval is chosen to be low, which leads to the integration of neighboring gray matter.

The scattering coefficient ${m}^{\prime}$ is actually a characteristic property of distinct tissue structures. The exact numerical value, however, is not necessarily known before the segmentation. Therefore, the choice of different ${m}^{\prime}$ has also been examined. According to Fig. 6, an increasing scattering coefficient ${m}^{\prime}$ , which also influences the growing process [see Eq. 12], leads to an increase of the JC index and the HD. A good trade-off between JC index and HD is therefore achieved if ${c}_{1}=0.93$ , ${c}_{2}=1$ , and ${m}^{\prime}=4$ .

## 3.4.2.

#### FRG

For the FRG parameters, the two scenarios PM-FRG and CD-FRG have been evaluated. In both cases, the following parameters can be varied: the edge threshold parameter $K$ , the number of iterations $N$ , and, as for the ARG case, the choice of confidence interval shift parameters ${c}_{1}$ and ${c}_{2}$ [see Eq. 15]. The results for the PM-FRG scenario are shown in Fig. 7 for different PCRs. The following observations can be made: with increasing number of iterations, the JC index increases and the HD decreases. For decreasing values of the confidence interval shift parameter ${c}_{1}$ , the same observation holds. With increasing the edge threshold parameter $K$ , the HD increases almost linearily while the JC index features a local optimum at threshold parameters $K=4\dots 10$ . For $K=11\dots 20$ , the JC index decreases. The performance of the CD-FRG (see Fig. 8 ) almost features the same characteristics although at $\mathrm{PCR}=20$ , the local optimum of the JC index is not distinct. A good trade-off between JC index and HD is therefore achieved for low values of $K$ (e.g., $K=3\dots 5$ ). The number of iterations and the confidence interval parameter ${c}_{1}$ should be chosen according the desired leakage performance.

The major difference between the ARG and the FRG approaches can already be observed. For all parameter settings, the FRG approaches perform worse in terms of JC index and HD distance. For an equal HD performance, the JC index of the FRG approaches is much lower than for the ARG approach and there is no parameter choice for the FRG approaches, which would provide the same performance. For further comparison of both, ARG and FRG, the parameters $N$ , $K$ , and ${c}_{1}$ were chosen as $N=40$ , $K=4$ , ${c}_{1}=0.99$ , and ${c}_{2}=1.01$ .

In order to further elaborate the different characteristics of ARG and FRG approaches, Table 2 shows averaged quantitative results for $n=100$ simulated B-scans at a PCR of 20. Figure 9 visualizes the performance for different contrast ratios based on an evaluation of $n=100$ simulated B-scans. Figure 10 shows an exemplary segmentation result for a PCR of 20. In all cases, the parameters were chosen as discussed above.

## Table 2

Averaged results for region growing approaches for n=100 simulated B-scans. Shown are the mean, maximal, and minimal JC index, HD and time consumption for a contrast ratio of PCR=20 of the simulated B-scans. Parameters of the respective filters were chosen such that the mean JC index is in the same range.

JC index | HD | Time (s) | |||||||
---|---|---|---|---|---|---|---|---|---|

Mean | Maximum | Minimum | Mean | Maximum | Minimum | Mean | Maximum | Minimum | |

ARG | 0.4887 | 0.5442 | 0.4168 | 19.05 | 31.95 | 13.60 | 1.57 | 2.15 | 0.93 |

PM-FRG | 0.2869 | 0.3486 | 0.2273 | 22.30 | 36.72 | 12.73 | 0.53 | 0.75 | 0.41 |

CD-FRG | 0.3025 | 0.4549 | 0.1925 | 25.91 | 47.38 | 13.60 | 0.89 | 1.15 | 0.75 |

## 3.5.

### Real Results

To show the performance of the three approaches for the segmentation of real OCT images of biological tissue, two image types with different segmentation criteria were tested.

## 3.5.1.

#### Segmentation of highly scattering structures such as white matter

Possible applications of white matter segmentation include the integration of OCT into neurosurgical settings (e.g., into an operating microscope). This would provide the surgeon with detailed tissue information during the operation, which would benefit especially within delicate surgeries. Three test images were acquired from the brain of a freshly decapitated rat. The brain was dissected and scanned along a coronal section crossing the striatum, which contains white matter fibers.

## 3.5.2.

#### Segmentation of low scattering structures such as blood vessels

Here, the seed detection and the region growing is performed on the inverted gray-scale image. Thus, dark areas of low scattering structures (e.g., vessel) are assigned a high intensity while areas of high scattering (e.g., tissue) are featuring low intensities. Thus, the seed detection and the region-growing algorithms can be applied as described.

Table 3 gives the details of all tested segmentation scenarios. For the evaluation of the segmentation performance for real images, a manual segmentation was performed by an OCT expert with $10\phantom{\rule{0.3em}{0ex}}\text{years}$ of experience in OCT imaging. Visual results are presented in Figs. 11, 12, 13, 14, 15, 16 . Numerical results provide the JC index and HD with regard to the manual segmentation results and are listed in Tables 4, 5 .

## Table 3

Real OCT imaging scenarios.

Scenario | Region of interest | Figure | Imaging source |
---|---|---|---|

wm1 | White matter fibersin coronal rat brain section | 11 | Swept Source Microscope System (Thorlabs, Inc., Newton USA) |

wm2 | White matter fibersin coronal rat brain section | 12 | Spectral radar OCT imaging system (Thorlabs HL GmbH, Luebeck, Germany)center wavelength at $930\phantom{\rule{0.3em}{0ex}}\mathrm{nm}$ |

Onion | Onion cell walls | 13 | Spectral radar OCT imaging system (Thorlabs HL GmbH, Luebeck, Germany)center wavelength of $830\phantom{\rule{0.3em}{0ex}}\mathrm{nm}$ |

Urothel | Vessels embedded into urothel | 14 | Time domain OCT imaging system (4optics GmbH, Heidelberg, Germany)center wavelength of $1310\phantom{\rule{0.3em}{0ex}}\mathrm{nm}$ |

Intestine | Vessels embedded into intestine wall | 15 | Spectral radar OCT imaging system (Thorlabs HL GmbH, Luebeck, Germany)center wavelength of $830\phantom{\rule{0.3em}{0ex}}\mathrm{nm}$ |

Egg | Vessel embedded inner skin of egg | 16 | Spectral radar OCT imaging system (Thorlabs HL GmbH, Luebeck, Germany)center wavelength of $940\phantom{\rule{0.3em}{0ex}}\mathrm{nm}$ |

## Table 4

Results of ARG, PM-FRG, and CD-FRG for segmentation of highly scattering tissue in comparison to expert manual segmentation.

JC index | HD | Time (s) | |||||||
---|---|---|---|---|---|---|---|---|---|

Scenario | ARG | PM-PRG | CD-FRG | ARG | PM-FRG | CD-FRG | ARG | PM-FRG | CD-FRG |

wm1 | 0.3347 | 0.3232 | 0.3316 | 44.55 | 63.28 | 44.45 | 1.7 | 0.9 | 2.8 |

wm2 | 0.2371 | 0.077 | 0.1446 | 61.07 | 59.21 | 63.02 | 2.2 | 1.6 | 3.3 |

onion | 0.3013 | 0.2564 | 0.2687 | 129.71 | 139.17 | 112.29 | 2.4 | 1.4 | 2.8 |

## Table 5

Results of ARG, PM-FRG, and CD-FRG for segmentation of low scattering tissue in comparison to expert manual segmentation.

JC index | HD | Time (s) | |||||||
---|---|---|---|---|---|---|---|---|---|

Scenario | ARG | PM-PRG | CD-FRG | ARG | PM-FRG | CD-FRG | ARG | PM-FRG | CD-FRG |

urothel | 0.2101 | 0.1352 | 0.0974 | 54.64 | 59.07 | 59.07 | 0.3 | 0.7 | 0.26 |

intestine | 0.3139 | 0.3018 | 0.1250 | 39.05 | 37.64 | 38.47 | 0.4 | 1.3 | 1.0 |

egg | 0.6443 | 0.4330 | 0.3610 | 52.08 | 56.23 | 56.24 | 4.3 | 2.7 | 2.3 |

## 4.

## Discussion

## 4.1.

### Seed Detection

Numerical results shown in Table 1 indicate that the method described in Sec. 2.2 provides a robust way to locate seed points for a subsequent region growing. Performance of the seed detection, however, is naturally dependent on the PCR. The higher the difference of the scattering properties of different structures is, the easier these structures can be discriminated. That is due to the stepwise approach of seed detection: the determination of the seed candidates is based on an analysis of the first derivative of the intensity course. A low PCR will not lead to a significant change in the intensity, and peaks cannot be differentiated leading to a small set of peak candidates. Evaluation of extensive testing led to the heuristics based on ROC analysis for the choice of the threshold parameters depending on the PCR. Results show that for different PCR, the optimal parameters ${\sigma}_{1}$ , ${\sigma}_{2}$ , and ${\sigma}_{3}$ are almost constant and can thus be used for detection without previous determination of the PCR. This property enables the automatic nature of the process.

Also for the real OCT images, the presented results indicate an adequate performance of the seed detection. This especially applies to the task of detecting seeds in low scattering structures, such as blood vessels, as the PCR of these structures in the inverted gray-scale images is relatively high. For the white matter identification in real OCT images, the PCR is found to be $\mathrm{PCR}\approx 20\dots 25$ . Transfering the results shown in Table 1, the seed detection would provide identification of over 90 percent of the structures in the real images.

## 4.2.

### Region Growing

Both, the ARG and FRG approaches are dependent on certain parameters, which have already been discussed in Sec. 3.4. Parameters for the simulation scenarios were chosen as specified in Sec. 3.4. In all test scenarios, the ARG and both of the FRG have been applied with equal settings of the seed detection. Observing the simulation results in Table 2 and in Fig. 9, the following statements can be made: For all PCRs, the ARG approach provides a higher JC index while featuring a lower HD. This indicates less leakage while a better similarity between segmented and original regions is provided. This especially holds at a PCR of 20, which corresponds to the contrast ratio in real OCT images of brain matter.

It can be seen that for increasing PCR, the increase of the JC index of the PM-FRG is more substantial: The PM-FRG JC index increases by 46% for PCR increase from 20 to 30 while the ARG JC index increases only by 31% (see Fig. 9). This indicates that the higher the PCR is, the better the edge-sensitive filtering applies to the OCT images. Results of the ARG approach in Fig. 9 show that the adaptive homogeneity criterion applies well to the problem because the white matter structures are well segmented and only minor leakage can be observed. The results of the FRG in Fig. 10, however, show that substantial leakage occurs. This is indicates the major shortcoming of the FRG approaches in comparison to the ARG approach: the edge-sensitive filtering does alter the image. If the edge threshold parameter $K$ is chosen too high then the edges will be blurred and the region growing will lead to leakage. This especially holds for the lower edges of the white matter structures because these feature a less distinct intensity difference to the neighboring regions than the higher edges. If the parameter $K$ , however, is chosen too low, speckle-noise corruption will not be compensated and the subsequent region growing will lead to a lower JC index because no homogenous regions are provided after filtering.

Segmentation results performed on real images show the capability of the algorithms. Segmentation of different tissue types is demonstrated as two types of structures: one being bright and one being a dark region. Visual inspection indicates that the ARG approach is a better candidate for automated segmentation for the analyzed structures. Mainly ARG results show that white brain matter from real OCT B-scans and onion cell walls can be identified with a moderate presence of leakage (see Table 4 and Figs. 11, 12, 13). The numerical comparison to the manual segmentation of an OCT expert in Table 4 shows two tendencies: (*i*) For a comparable JC index (e.g., wm1), the HD of the ARG approach is smaller than for the results of the FRG approaches. (*ii*) If a comparable HD is achieved (e.g., wm2), the JC index of the ARG is higher than for the results of the FRG approaches. For the identification of low scattering structures, this tendency also holds (see Table 5). Visual inspection of the results also supports the conclusion that incorporation of OCT modeling into the segmentation approach provides a better structure identification. In the Egg scenario (see Fig. 16), ARG’s segmentation results show an undesired oversegmentation, which is attributed to having the same homogeneity criterion parameters in all real images. This is a case in which the parameters should be tuned to provide a laxer region growing.

Interestingly, the time-consumption characteristics differ for both scenarios. While for identification of high scattering structures, the PM-FRG approach outperforms the ARG, the opposite behaviour can be observed for the identification of low scattering structures. In general, one would expect the FRG approach to be computationally more expensive than the ARG approach as an additional filtering step is required. Note, however, that time consumption also incorporates the process of region growing. A higher JC index at a comparable HD means that the region-growing process took longer as more structures of interest are segmented. Thus, time consumption does not directly allow a qualitative comparison of the approaches.

Considering the parameter sensitivity for both RGAs, heuristics can be drawn from extensive simulations (see Sec. 3.4). As stated in Sec. 3.4, results from simulated images indicate a preferable choice of parameters. For the ARG approach, this leads to a choice of ${c}_{1}=0.93\dots 0.97$ , ${c}_{2}=1$ , and ${m}^{\prime}=4$ . For the FRG approaches, a well-performing set of parameters is given by $N=40$ , $K=4$ , and ${c}_{1}=0.99$ and ${c}_{2}=1.01$ .

Both seed detection and ARG are inherently dependent on the speckle size. While for the illustrated theoretical approach, the speckle size is assumed to equal $1\phantom{\rule{0.3em}{0ex}}\text{pixel}$ in the image, this does not necessarily correspond to a real measurement scenario. There, the speckle size is related to the point-spread function of the measurement system. Therefore, speckle size might include more than $1\phantom{\rule{0.3em}{0ex}}\text{pixel}$ . In that case, the outlined approach would have to be adapted, namely, by the extension of the pixel-related criteria based on an estimation of speckle size. For the seed detection, for instance, the ratio in Eq. 9 would compare the intensity at $\stackrel{\u0303}{I}({z}_{k}+n)$ with the intensity $\stackrel{\u0303}{I}({z}_{k}+n-{s}_{z})$ , where ${s}_{z}$ would be the axial number of pixels occupied by a speckle. Equally important, the pixel neighborhood size would have to be adapted to the speckle size (the larger the speckle size, the larger the neighborhood).

The proposed region growing approach is presented for the identification of two distinct tissue structures. If tissue structures with more homogeneities are subject to segmentation (e.g., the retinal structure, which is a layered composite), the approach would have to be adapted. In this case, adaption would mostly affect the seed-detection intelligence, which would have to robustly identify at least one seed in each layer. As the growing criterion relies on a general OCT model, it should apply in its present form. Parameters, however, may have to be adapted to the respective task.

## 5.

## Conclusion

Summarizing this work, two approaches for the automated segmentation of tissue structures in OCT data have been developed. A two-step approach is taken: In a first step, automated seed detection for a subsequent region-growing algorithm is done. On the basis of the seeds, two alternatives for the homogeneity criterion within the region growing are proposed. The first region growing relies on an adaptive-neighborhood criterion and works on the original OCT data (ARG approach). The homogeneity criterion reflects the deterministic intensity course of OCT imaging in tissue and the speckle-noise corruption. The second approach uses an edge-sensitive filtered version of the image and applies a median-based homogeneity criterion (FRG approach).

Generally, the ARG approach provides a better segmentation for all contrast ratios of different tissue structures. Test results on white matter detection in brain imaging show the capabilities of the approaches. As a general tendency, results show that the ARG approach is more suitable for segmentation of structures in OCT images. Thus, it can be concluded that incorporation of an OCT model (deterministic intensity decay and speckle noise) does apply better to this image-processing task than filtering, which alters image information.

Further work to optimize the method’s performance still remains, mainly to raise sensitivity in real scenarios and reduce leakage. However, the ARG approach shows strong potential to become a helpful tool in navigation and diagnosis. Other types of filtration for the FRG approach with a strict denoise-alteration compromise may also yield to better results. Because OCT has not yet been widely applied to neurosurgery, automated image processing opens the door to novel applications to be developed. The study in Ref. 3 shows evidence that the gray-white matter junction is a structure OCT can detect with high optical contrast and that it could serve as a landmark for guiding procedures such as deep brain stimulation. This application could benefit from the work presented in this paper. Segmentation of vessel structures, which was also shown to be feasible, could be used in other medical applications. Because the proposed algorithm is based on a general formulation of the OCT intensity model, it may be adapted for other segmentation tasks as well.