Translator Disclaimer
15 August 2018 Clinical lymphocytes construction for light scattering inversion study: a three-dimensional morphology constructed method from defective confocal images
Author Affiliations +
Constructing models of cells’ realistic internal and external morphology is vital for correlation between light scattering and morphology of the scattering structure. The image stack obtained from fluorescent confocal microscopy is at present used to construct the cell’s three-dimensional (3-D) morphology. However, due to the poor labeling quality and unavoidable optical noise present in the image stacks, 3-D morphologies are difficult to construct and are an impediment to the statistical analyses of cell structures. We propose a method called the “area and shape constraint method (ASCM)” for constructing 3-D morphology. Blurred 3-D morphologies constructed by common methods from image stacks considered as defective and which are commonly discarded are well restored by the ASCM. Seventy-four clinical blood samples and a series of standard fluorescent spheres are selected to evaluate the validity and precision of our proposed ASCM. Both the qualitative and quantitative results obtained by ASCM indicate the good performance of the method in constructing the cell’s 3-D morphology.



When a cell is illuminated, light scattering happens due to the interaction of the cell’s complex biological structures with the optical radiation. It has been proven that the rich features in the scattered light distribution are closely related to the morphologies and inhomogeneous refractive index of the external membrane, internal nucleus, and other organelles.1 As a result, the light scattering pattern (LSP) contains the cell’s “fingerprint,”2 which is expected to provide an exquisitely sensitive approach for noninvasive and label-free determination of cellular morphology and, consequently, its use in cytopathic discrimination.37 As a prominent example of its application, the forward and side scattering intensities in the LSP are applied in the well-known flow cytometry for cell sorting and identification. Lymphocytes in human peripheral blood are a type of white blood cell generated by the immune system to defend the body against cancerous cells, pathogens, and foreign matter. The morphology changes of lymphocytes deduced from LSP can be used to predict the onset of diseases.8,9 The research in which cells of different types or pathological conditions are identified by their specific features extracted from the LSPs is called the LSP inversion study. The inversion study, a powerful tool to reveal variations of the cell’s morphology and composition from information contained in the scattered light, is a label-free method for cell identification. The key scientific problem in the LSP inversion study is to figure out the specific and sensitive scattering light features and their statistical distributions among the samples. It is important to know in advance the cellular structures that scatter the light in LSP inversion study. Thus, to identify the key features of light scattering from clinical lymphocytes, a three-dimensional (3-D) shape model is set up with the membrane, nucleus, and proper optical structures to mimic their pathological conditions.7,1020 The LSP of the model is simulated by some numerical methods, such as the finite-difference time-domain (FDTD)21,22 and discrete dipole approximation.23,24 Finally, specific LSP features are extracted according to the statistical principles by analytical methods, such as machine learning.2528 Above all, an accurate and suitable model of lymphocytes is vital. A simple model is to consider the membrane and nucleus of lymphocytes as ideal spheres or ellipsoids.7,1820 Recent research29 proposes more precise modeling method to construct 3-D structures from a stack of two-dimensional (2-D) confocal images, in which the real shapes of fluorescence-labeled membrane and nucleus are recorded. To the best of our knowledge, this method gives the best result for obtaining the cell’s 3-D morphology at present. In this work, both manual labeling for different cellular structures and imaging by fluorescence confocal microscopy are used. The labeling quality is rather compromised as about 80% to 90% of cells cannot be constructed directly from the stack of 2-D confocal images because the images of the top and bottom cellular structures are normally incomplete. Some algorithms for constructing 3-D cell structure from its image stack have been reported.29 But these algorithms are focused on how to build up the 3-D structures for well-labeled cells. The stack with incomplete cell structures has to be discarded even though only a small number of image layers in the stack are invalid. As a result, LSP inversion study with the current construction methods cannot meet the requirements for statistical investigations. It is the original intent of our research to improve on the current method. If the invalid image layers in the discarded stack can be recovered by some structural relations with the valid layers, then an approximate constructed morphology with acceptable accuracy could be retrieved from discarded image stacks. There are two problems herein: one is how to determine invalid layers in stack and the other is how to build up the structural relations between the valid and invalid layers. A set of algorithms called the area and shape constraint method (ASCM) is developed by our group to solve these two problems. In this method, the image entropy is applied to determine the invalid layers, and the area and termination shape recursive relation is applied to build up the relation between the invalid and valid image layers. The samples used for verifying the method are clinical lymphocytes of human peripheral blood in suspension and standard spheres with known structural parameters. Three kinds of methods are designed to evaluate the performance of ASCM. The results proved that ASCM is a promising method in 3-D cell modeling for light scattering inversion study and its use in statistical investigations.




Sample Preparation

The morphologies of membrane and nucleus of clinical lymphocytes are being investigated in our research. Clinical lymphocytes are always in a suspension during the whole process of sample preparation, even during sample imaging by fluorescence confocal microscopy so as to maintain their primitive morphologies. A key problem is how to select the suitable fluorescence dyes. On the one hand, it can select to specifically bind the components of the cells under research; on the other hand, after fluorescence confocal imaging, the dyeing cellular components must be conveniently separated from others often through digital image processing. To meet the requirements, instead of labeling cytoplasm and nucleus of lymphocytes as done in previous research,1317,29 the membrane marker CM-DiI V22888 (Life Technologies Co., Ltd.) and the nucleus marker Dapi S36968 (Life Technologies Co., Ltd.) are selected to effectively distinguish the edges of nucleus–cytoplasm and cytoplasm membrane. The absorption spectral peak and the exciting fluorescence peak for CM-DiI V22888 are at 553 and 570 nm, respectively, and for Dapi S36968 they are at 364 and 460 nm, respectively. The speed and duration of centrifugation, the temperature for lymphocyte separation and labeling, the washing times after labeling should be well controlled and optimized to prevent morphology damage of the clinical lymphocytes. Our procedure is as follows. Fresh clinical lymphocyte cells, collected within 2 h, are separated from human peripheral blood with lymphocyte separation liquid (Tian Jing Haoyang Biological Manufacture Co., Ltd., China). The separated lymphocytes are then diluted with phosphate-buffered saline (PBS, pH 7.4) to a concentration of 105 to 106  cell/mL. 5-μL CM-DiI V22888 is added into 1-mL diluted lymphocyte sample and the sample is incubated for 30 min at 37°C. After incubation, the labeled sample suspension is centrifuged for 5 min with 400 g centrifugation force at 37°C. The supernatant is then removed and the leftover is washed gently with PBS (37°C) twice. Another sample is diluted again to a concentration of 105 to 106  cell/mL with PBS (37°C). Finally, the sample is incubated for 5 min after adding 2 to 3 drops of Dapi S36968. To ensure spatial stability of lymphology during fluorescence confocal imaging, a 20 to 30  μL drop is dripped on to a 60-mm glass bottom dish with a 14-mm bottom well (In Vitro Scientific Co., Ltd.). The sample drop is controlled empirically with a hemispherical surface in the bottom well. The suspended lymphology is therefore kept almost still by surface tension during the confocal scanning and imaging.


Confocal Microscopy

The samples are scanned along the z-axis by the laser scanning confocal microscope (LMS780, Zeiss) using a 100× oil immersion objective lens. The membrane (red) and nucleus (blue) are recorded in an RGB image with the resolution of 512×512  pixels. The step size of z-scan is set at 0.1  μm. One result of our confocal image stack is shown in Fig. 1.

Fig. 1

(a) Confocal image stack. The donor, age 44, female, is suffering from severe chronic hepatitis B. The stack of 2-D confocal images is acquired along the z-axis. The red fluorescence was excited from the dyed membrane. The blue fluorescence was excited from the dyed nucleus. Image #68 with a yellow frame is the layer with the maximum area cross section of the membrane. Images in the two green frames are invalid layers, which will be introduced in Sec. 2.3.2. (b) The membrane is constructed directly from the stack shown in (a). The whole constructed lymphocyte consists of the outer membrane (red color) and the inner nucleus (blue color). Due to the incomplete constructed 3-D morphology of the membrane, the nucleus is exposed. (c) Nucleus constructed directly from the stack shown in (a). To display the nucleus, the constructed lymphocyte shown in (b) is split. It can be seen that the constructed morphologies at the top and bottom of both the membrane and the nucleus are incomplete.



Area and Shape Constraint Method

Due to the incomplete morphology constructed directly from the image stacks, as shown in Figs. 1(b) and 1(c), the ASCM is proposed. The 3-D morphology generator program of ASCM has been developed, which consists of three steps: image preprocessing, layer restoration, and 3-D morphology construction.


Image preprocessing

The goal of image preprocessing is to extract the contours of the membrane and nucleus in each image layer. Taking layer #68 in Fig. 1 as an example, the image preprocessing flowchart is shown in Fig. 2(a). Because the membrane and nucleus are labeled in our experiments, it is not difficult to extract the contours of the membrane (red color) and the nucleus (blue color). Normally, there is an unstained cytoplasm region (black color) between them. We first separate the red and blue components from image pixels in the RGB format. For either the membrane or nucleus, only the R or B pixel channel is retained. The grayscale images for R and B pixel channel are obtained separately. A Gaussian 2-D window average filtering algorithm is adopted to remove the speck noise. The filtering is carried out via the convolution of the intensity reading of a pixel over a grid of 15×15, centered on the pixel, with a kernel of exp[(i2+j2)/32], 7i7, and 7j7. For the threshold segmentation, the Otsu method, the minimum error method, or the maximum entropy method30 can be applied to separate the membrane and nucleus from the background, and then their corresponding binary images are generated. Due to the similar results for different threshold segmentation methods, we selected the Otsu method with its threshold k* parameter satisfying the following conditions:

Eq. (1)


Eq. (2)

where P1 and P2 are the classification probabilities by the threshold k* of the blue and red pixels, respectively, m1 and m2 are the mean image intensity values of the blue and red pixels, respectively, and mG is the global mean intensity. The binary images obtained for the membrane and nucleus can be seen in “binary image” of Fig. 2. Finally, the contours of the membrane and nucleus are filled in by image filling operations. And the max connected region processing is adopted to remove abnormal signals shown in Fig. 2(b). The reason of abnormal signals is that some unknown reasons make unwanted regions dyed by fluorescence dyes. They sometime occur and cannot be removed the filtering processing. In the case, the max connected region processing becomes necessary.

Fig. 2

Image preprocessing for membrane and nucleus. The preprocessing of image #68 shown in Fig. 1 is used as an example. After the grayscale, Gaussian 2-D window average filter is adopted to smooth the pixel distributions and remove the speck noise. The filtering is carried out via the convolution of the intensity reading of a pixel over a grid of 15×15, centered on the pixel, with a kernel of exp[(i2+j2)/32], 7i7, and 7j7. (a) The image preprocessing flowchart. (b) The max connected region processing.



Layer restoration

The purpose of layer restoration is to determine and restore the invalid layers, in which the contours of the membrane or nucleus are imaged unrecognizably or not recorded at all due to the poor quality of dyeing and microscope imaging. In the ASCM method, to determine the invalid layers, the image entropy value method is selected. The area recursive relation and the termination shapes of the valid images are extracted and applied to restore the profiles of membrane and nucleus in the invalid layers. The detailed procedure for layer restoration is as follows:

  • Step 1: Determining the valid and invalid image layers.

It is known that the image layers close to the maximum area cross section have better image quality. But the image layers close to the cell’s top and bottom layers are normally fuzzy and not easily identifiable, such as image #1 to #15 at the top and image #118 to #135 at the bottom of the cell as shown in Fig. 1. The main reason is that in the region near the maximum area cross section there are more labeled substances. For layers near the maximum area cross section, the gray values of the membrane and nucleus are close to 255. However, for layers near to top and bottom of the cell, the gray values are gathered in a small range with low pixel values, which are approximately close to those of background noise. According to the Shannon information theory,30 the entropy is a statistical description for the randomness of data and can be used to characterize image textures. An image with a large entropy value contains more information. The definition of image entropy E is given by the following equation:31

Eq. (3)

where i is the image grayscale value and p(i) is the distribution probability function of i. The entropy is calculated from the image grayscale. The entropy of the layer with maximum area cross section for the membrane or nucleus is given by the symbol Em. We then define the image entropy to be kEm (k[0,1]) for each layers in the stack. In our experiments, k is empirically selected to be equal to 0.9. We calculate the entropy of each layer shown in Fig. 1 and display the results in Fig. 3. The abscissa and ordinate in Fig. 3 relate to the image layer number and image entropy, respectively. Em, the entropy of image #68, equals to 6.86 (arb. unit). Following the definition of an invalid layer, image layer #1 to #24, and #94 to #135 are considered invalid and are highlighted by green frames in Fig. 1. The maximum area cross sections for both the membrane and nucleus shown in Fig. 1 are in the same layer (image #68). But this does not always happen. Therefore, in practice, the invalid layers for the membrane and nucleus should be determined separately.

  • Step 2: Establishing the area constraint and the shape constraint.

Fig. 3

Image entropy. Image entropy values of each image in Fig. 1 are shown. The total confocal image number in Fig. 1 is 135.


Three characteristics are required to restore the contours in an invalid layer: the centroid, the area, and the shape.

The position of the centroid is the criterion to align contours in each image layer. Suspended cell movement during microscope scanning can offset the centroid for different layers and can even cause cells to vanish in the field of view. With the surface tension described in Sec. 2.1, centroid offset caused by cell movement is restricted and can be calibrated. The centroids of the contours of the valid image layers are aligned by image processing algorithms (see details in Sec. 2.3.3).

The area sj of each valid image layer is calculated to establish the area constraint recursive relation. For clinical lymphocytes in human peripheral blood, despite the varying degrees of roughness due to ruffles and folds, the morphology for their membranes or nuclei is basically like an ellipsoid, which can be expressed mathematically as x2a2+y2b2+z2c2=1, as shown in Fig. 4(a). The area sj in the j’th image layer satisfies the equation sj=πajbj, where bj=b1h2(j)c2 and aj=a1h2(j)c2 (ch(j)c). The height h(j) of each layer satisfies the equation h(j)=j×Δz, where Δz is the scanning distance interval of the confocal microscope. With sj computed from aj, bj, and h(j), the area constraint can be described by the following equation: sj=p1j2+p2j+p3, where the parameters p1, p2, and p3 can be determined from a curve fitting of the areas of the membrane or nucleus of the valid image layers. That is, we assume the area sj satisfies a quadratic dependence with the layer number j. The membrane shown in Fig. 1 is used as an example. After image preprocessing as described in Sec. 2.3.1, images of #25 to #93 are determined as valid layers. The pixel area of the membrane in these layers is obtained [the dotted curve shown in Fig. 4(b)] and then fitted with the quadratic area curve sj=(11.84)j2+1578.74j16447.58, (j=25 to 93) [the solid curve in Fig. 4(b)]. Thus, in this case, p1,p2, and p3 are found to be equal to 11.84, 1578.74, and 16447.58, respectively. To verify the quadratic relation is a good fit to the data, the relative error between the fitted curve and the data is calculated and shown in Fig. 4(c). It can be seen that their relative errors are small and all <2.25%, which proves that for lymphocytes a quadratic relation of j and sj is reasonable.

Fig. 4

The area and shape constraint. (a): (a1), (b1), and (c1) are the front view, left view, and top view of interface along A–A, respectively, (b) is the area and its quadratic fitting curve, (c) is the relative error between the area value and its quadratic fitting curve, (d) is the result of applying shape constraint, (e) is the result of applying area and shape constraint described in steps 1 and 2 of Sec. 2.3.2, (f) is the result before and after the interpolation process, and (g) is the reconstructed membrane and nucleus with and without applying ASCM for the lymphocyte in Fig. 1.


The termination layers in the last valid image at the top and bottom of the cell are used to approximate the areas of the invalid layers by ASCM. For the membrane shown in Fig. 1 as an example, the termination layers are image #25 and #93 (microscope scan from the cell’s bottom to top layer). After deciding the termination layers, its shape is shrunk until its area equals to the value sj calculated by the area constraint obtained from the valid layers. This is shown in Fig. 4(d). Figure 4(e) shows the reconstructed shape using centroid alignment and applying the area and shape constraint described in step 2.


Three-dimensional morphology construction

To achieve 3-D morphology construction, the centroids of the contours in both the valid and restored invalid layers are calculated and aligned strictly. For the confocal image stack, the resolutions in x-, y-, and z-direction are normally different. In our experiments, the resolutions in x-, y-, and z-direction are 0.04, 0.04, and 0.1  μm, respectively. Therefore, interpolation is implemented to improve the resolution in the z-direction by inserting an extra layer. First, we fitted the contours in each valid and the restored invalid layer by Fourier series fitting method. The origin of the polar coordinate (ρ,θ) is set up at the centroid of each layer. Second, the extra layer inserted is interpolated from the neighboring layers. The known ρ in each layer is used to establish the Lagrange interpolation function32 for determining the interpolated ρ values. The results are shown in Fig. 4(f). After the interpolation, the resolution in z-axis is improved to 0.05 μm. For the lymphocyte shown in Fig. 1(a), the final reconstructed membrane and nucleus obtained by ASCM are shown in Fig. 4(g).


Experimental Results and Discussions


Characteristics of Image Entropy Curves for Membrane and Nucleus

To verify that the image entropy curves for different clinical lymphocytes are similar to that shown in Fig. 3, 74 clinical lymphocytes from 15 donors are tested. Their entropy curves for both membranes and nuclei are shown in Fig. 5 for comparison. Figures 5(a-1) and 5(b-1) show the good distribution agreement of image entropy curves for different clinical lymphocytes. Figures 5(a-2) and 5(b-2) are the statistical histogram for 74 clinical lymphocytes. According to Shannon theory,30 the image entropy E increases with the value of p(i) as can be seen in Eq. (3). Both i and p(i) are determined from the 2-D confocal images. Therefore, it is necessary to discuss the gray values in images in order to be able to analyze the characteristics of their entropy curves. Using the lymphocyte shown in Fig. 1 as an example, the image layers #15, #30, #45, #60, #75, #90, #105, and #120 are selected. The gray value distributions for both the membrane and nucleus are analyzed. The background noise is normally in the grayscale range from 0 to 50. The gray histograms of the membrane and nucleus after removing background noise are shown in Figs. 6(a-1) and 6(b-1). The entropy curves are shown in Figs. 6(a-2) and 6(b-2). It can be seen that the distribution range of grayscale values is wider for layers adjacent to the maximum area cross section due to the better labeling and imaging, such as image #60. For layers close to the maximum area cross section, their p(i) value is larger than those far from the maximum cross-section layer (such as image #120). This is the reason that the entropy E in Eq. (3) is larger for layers close to the maximum cross section.

Fig. 5

Image entropy values of membrane and nucleus. There are totally 74 lymphocytes of fresh human peripheral blood samples from 15 healthy individuals. Their focal image stacks are not shown. (a-1) and (b-1) The normalized image entropy results of membranes and nuclei, respectively. The yellow boxes are applied to highlight the regions of membrane and nucleus with the image entropy larger than 0.9Em. (a-2) and (b-2) The statistical histogram for 74 clinical lymphocytes, which show the number of lymphocytes (the ordinate) whose entropies in the corresponding image layer (the abscissa) are larger than 0.9Em. It proves that the valid image layers for 74 clinical lymphocytes are mainly in the yellow region in (a-1) and (b-1) with the image entropy larger than 0.9Em.


Fig. 6

The characteristics of confocal images. The lymphocyte shown in Fig. 1 is used as an example. In (a-1) and (b-1), the pixel distributions for membrane and nucleus are shown for each image layer. In (a-2) and (b-2), the entropy curves for membrane and nucleus are shown.



Validation of the Three-Dimensional Constructed Morphology

To validate the precision of the constructed morphology by ASCM, two types of experiments are designed by our group. One is called the valid image layer comparison (VILC) method and the other is the LSP method, which will be discussed in Sec. 3.3.

In the VILC method, a valid lymphocyte image stack is chosen and two neighboring layers are constructed by applying the area constraint. The constructed morphology is compared with the original contours of the valid image layers. The comparison is used to evaluate the precision of the constructed morphology by ASCM. In the range of valid image layers, the contour of the newly constructed morphology is labeled as A, and the original known contour is labeled as B. The centroids of A and B are aligned for each image layer. Subsequently, the overlapping area [labeled as Area (AB)] and the total area [labeled as Area (AB)] are calculated, respectively. The misclassified error (ME)30 is calculated from the mathematical expression in Eq. (4). Zero percent shows the best accuracy of ASCM

Eq. (4)


The 74 clinical lymphocytes analyzed in Fig. 5 are used for the comparison. One of their ME results is shown for both the membrane [seeing the subplot on the top of Fig. 7(a)] and the nucleus [seeing the subplot on the top of Fig. 7(b)]. Due to the different number of valid image layers for each lymphocyte, the maximum area cross-section layer for each lymphocyte is labeled as the zeroth layer. The abscissa of Fig. 7 is obtained after the number of the maximum area cross-section layer is subtracted the number of original image layer. From our experience, the invalid layers at the top and bottom of the lymphocyte account for about 10% of the cell size. In our experiments, the confocal microscope’s step size for the z-scan is 0.1  μm and sometimes 0.2  μm.

Fig. 7

The ME analysis of VILC method for membrane and nucleus. In subplots on the top of (a) and (b), the yellow and purple frames mean ME is <10% (yellow) and 5% (purple), respectively. For the membrane shown in the subplot of (a), the layers in the range 10 to +10 (yellow) and from 5 to +5 (purple) are considered. For the nucleus shown in the subplot of (b), the layers from 8 to +8 (yellow) and from 4 to +4 (purple) are considered. (a) and (b) show the ME box-whisker plots of all the 74 clinical lymphocytes. The ME means for different image layers are listed in the box-whisker plots.


For the lymphocyte membrane with diameters 9 to 12  μm and for the nucleus with diameters 6 to 8  μm, there are on average 10 invalid image layers for the membrane and 8 for the nucleus for 0.1-μm step size z-scan. For 0.2-μm step size, the number of invalid layers is halved. For one of the 74 clinical lymphocytes, its ME of the ±5th and the ±10th image layer for the membrane shown in the subplot of Fig. 7(a) and the ±4th and the ±8th image layer for the nucleus shown in the subplot of Fig. 7(b) is analyzed.

The box-whisker plots of ME results for all the 74 clinical lymphocytes are shown in Figs. 7(a) and 7(b), respectively. The ME mean values of the 74 samples are listed. It can be seen that all the mean values are <10%, and for ±5th and ±4th image layers of the membrane and nucleus are <5%. For the nucleus, the ME is larger than that of the membrane. The reason is that the number of image layers for the nucleus is less than that of the membrane due to its size; the layers far from the one that determines the shape constraint have lower precision. Thus, compared with the membrane, the ±4th and the ±8th image layers of the nucleus are further from its maximum cross section and thus their MEs are larger. For example, in Figs. 7(a) and 7(b), 8.88% is obtained for the 8th nucleus image layer, which is larger than 6.57% for the 10th membrane image layer. It is worthy to note that the VILC method for calculating ME gives an upper bound because only the information in the maximum area cross section and the neighboring two layers are applied to set the area and shape constraint. For the ASCM used in practice, the construction precision is much better than the VILC evaluation results. Therefore, if ME of VILC method can satisfy the construction precision requirements (<10%), the ASCM is undoubtedly more precise in constructing 3-D morphology of the confocal image stack.


Precision of Light Scattering Pattern

In the optical scattering inversion study, the LSP is the key criterion from which 3-D morphology is constructed. Therefore, the LSP is a convincing way to evaluate the precision of the constructed morphology by ASCM. With the help of the commercial software (FDTD solutions, Lumerical Inc, Canada), the LSP is calculated by our programs to construct the 3-D morphology. LSP of ideal spheres with radius r=0.2, 0.5, and 1.0  μm is used to construct the morphology and compared with the actual spheres. The results are shown in Fig. 8. The match is very good over the full range of the scattering angles, which proves our programs are correct and reliable.

Fig. 8

The angle-resolved LSP applying Mie theory and our programmed FDTD method for ideal spheres with radii 0.2, 0.5, and 1.0.


The standard fluorescence spheres with diameters 6.56, 9.44, and 10.00 μm [shown in Figs. 9(a-1)9(c-1), respectively] are selected for ASCM evaluation. The morphologies of standard fluorescence spheres are scanned by a confocal microscope and then constructed without applying ASCM [labeled as “original model,” shown in Figs. 9(a-2)9(c-2)] and with ASCM [labeled as “constructed model,” shown in Figs. 9(a-3)9(c-3)]. First, from the constructed morphologies, the constructed models look more like ideal spheres than the original models. For original models, there are serious deformations in the models’ top and bottom surfaces. But for the constructed models, these deformed sections are well restored by ASCM. Second, the original and constructed models are compared with that of ideal spheres as shown in Figs. 9(a-4)9(c-4). These spheres only differ in their volumes due to the different diameters. As we all know, the scattering intensity in the forward direction is most sensitive to the sample’s volume, and with current commercial flow cytometers, 2 deg to 5 deg and 2 deg to 19 deg are commonly selected to detect the forward scattering light. Thus, the LSP relative errors in the range 2 deg to 5 deg and 2 deg to 19 deg are compared for the original and constructed models with that of ideal spheres. The results are shown in Figs. 9(a-5)9(c-5). It can be seen that the relative errors for the original models with diameter 6.56, 9.44, and 10.00  μm are larger than those of constructed models in both the 2-deg to 5-deg and 2-deg to 19-deg range. Especially for the 6.56-μm standard sphere, the relative errors of original model shown in Fig. 9(a-5) are as high as 105.49% and 97.09% in the forward scattering 2-deg to 5-deg and 2-deg to 19-deg range, respectively. On the other hand, the errors of constructed model are only 19.10% and 18.34% in the range 2 deg to 5 deg and 2 deg to 19 deg, respectively. For the 9.44-μm standard sphere, the errors decrease from 8.79% of original model to 1.89% of constructed model in the 2-deg to 5-deg range and from 7.82% to 1.86% in the 2-deg to 19-deg range. For the 10.00-μm standard sphere, the errors decreased from 19.60% of the original model to 8.07% for the constructed model in the 2-deg to 5-deg range and from 12.00% to 2.20% in the 2-deg to 19-deg range.

Fig. 9

Precision evaluation by scattering pattern with and without the use of ASCM. Standard sphere: (a) D=6.56  μm, (b) D=9.44  μm, and (c) D=10.00  μm.


In conclusion, ASCM is an effective method for constructing morphology and can be applied to the image stacks that are usually considered as invalid or commonly discarded when using current methods. ASCM therefore would become a promising approach to process abundant clinical lymphocytes data, especially for statistical scattering inversion study.


Other Errors

There are still some other sources of error arising from sample preparation and hardware. In sample preparation, the high quality of cell fluorescence staining is the important step to obtain a clear and accurate 3-D constructed morphology. The specific and sensitive fluorescence dyes should be selected carefully with consideration to cell types, cellular organelles, and excitation light wavelength. During sample dyeing, the operations should follow the procedure recommended by manufactures but need to be adjusted and optimized according to the character and type of cells used. Normally, the excitation light peak wavelength used for fluorescence confocal microscopy may not exactly match with the manufacturer’s recommended peak wavelength of the dye. This can compromise the efficiency of fluorescence imaging for labeled cells. Additionally, in confocal microscopy, the refractive index matching problem and the sample movement along the scanning direction should also be considered. For the refractive index matching problem, if there is a large refractive index difference between samples and solution, for example with polyester samples (n=1.60) in the gelose solution (n=1.33), the microscope focus position during scanning will be in error. It may cause serious deformation in the constructed morphology. Therefore, calibration is needed before measurements. Another problem is the movement of the sample during imaging. There are two kinds of sample movements. One is the sample moving in the plane perpendicular to the scanning direction. This kind of movement can cause a change in the measured sample location. The morphology distortion by this kind of movement can be corrected by an image processing method. The other sample movement is along the scanning direction, which may lengthen or shorten the sample morphology in the image stack. However, the distortion created by this kind of movement is difficult to correct. To avoid or minimize this kind of movement, we find that samples can be kept almost still by surface tension of the 20 to 30  μL sample drop as described in Sec. 2.1. For our experiments, the numerical aperture and magnification of the microscope objective lens are 1.4 and 100× (oil immersion), and the samples are confined in special bottomed wells for fluorescence confocal microscopy. The optical aberration of the objective lens and other microscope lenses, as well as the scanning depth due to the refractive indices of immersed oil, and the bottom well can be calibrated by relevant compensation methods. Finally, the larger image size and the smaller scanning step obviously can improve morphology precision, but they cause an increase in the scanning time so that the labeled fluorescents may be bleached. It should be traded-off according to specific circumstances. The image of the size of 512×512 or 1024×1024 and 0.1- or 0.2-μm scanning step can be selected for clinical lymphocytes studies.



In the paper, ASCM is developed to construct 3-D morphology of clinical lymphocytes. The internal and external spatial morphology of lymphocytes are accurately constructed and digitized. This is very important in the light scattering inverse problem especially for its statistical research. To validate the precision of ASCM, first, we proved that image entropy can be an effectively standardized to determine invalid layers from valid ones in the confocal image stack. Then, the MEs of constructed morphology, as the worst case are found to be <10%, which can satisfy the requirements of statistical measurements in practice. Finally, the 3-D morphologies of standard spheres constructed with and without ASCM are compared. With ASCM, the distorted sections in the model without ASCM are well restored. The LSPs of both models with and without applying ASCM are then analyzed with the LSPs of ideal spheres. The small relative errors prove the good performances of ASCM. We hope that this work may provide a useful tool in conducting the statistical experiments and investigations for the inversion problem of the clinical cell’s scattering features.


The authors have no relevant financial interests in this article and no potential conflicts of interest to disclose.


This study was funded by the National Natural Science Foundation of China (Grant No. 61405155), the China Postdoctoral Science Foundation (Grant No. 2016M602807), the Fundamental Research Funds for the Central Universities, and the Collaborative Innovation Center of Suzhou Nano Science and Technology (NANO-CIC).



D. Dannhauser et al., “Single-cell screening of multiple biophysical properties in leukemia diagnosis from peripheral blood by pure light scattering,” Sci. Rep., 7 12666 (2017). SRCEC3 2045-2322 Google Scholar


G. I. Ruban et al., “Investigation of morphometric parameters for granulocytes and lymphocytes as applied to a solution of direct and inverse light-scattering problems,” J. Biomed. Opt., 12 (4), 044017 (2007). JBOPFO 1083-3668 Google Scholar


M. Kinnunen and A. Karmenyan, “Overview of single-cell elastic light scattering techniques,” J. Biomed. Opt., 20 (5), 051040 (2015). JBOPFO 1083-3668 Google Scholar


J. Yoon et al., “Label-free characterization of white blood cells by measuring 3D refractive index maps,” Biomed. Opt. Express, 6 (10), 3865 –3875 (2015). BOEICL 2156-7085 Google Scholar


A. Mashaghi et al., “Label-free characterization of biomembranes: from structure to dynamics,” Chem. Soc. Rev., 43 (3), 887 –900 (2014). CSRVBR 0306-0012 Google Scholar


S. A. Rosenberg, “Cell transfer immunotherapy for metastatic solid cancer—what clinicians need to know,” Nat. Rev. Clin. Oncol., 8 (10), 577 –585 (2011). Google Scholar


H. Shahin et al., “Physical characterization of hematopoietic stem cells using multidirectional label-free light scatterings,” Opt. Express, 24 (25), 28877 –28888 (2016). OPEXFF 1094-4087 Google Scholar


L. Zhang et al., “Light scattering properties in spatial planes for label free cells with different internal structures,” Opt. Quantum Electron., 47 (5), 1005 –1025 (2015). OQELDI 0306-8919 Google Scholar


L. Zhang et al., “Relation between clinical mature and immature lymphocyte cells in human peripheral blood and their spatial label free scattering patterns,” Rev. Sci. Instrum., 87 (7), 074301 (2016). RSINAK 0034-6748 Google Scholar


Y. Zhang et al., “Comparative study of 3D morphology and functions on genetically engineered mouse melanoma cells,” Integr. Biol., 4 (11), 1428 –1436 (2012). 1757-9708 Google Scholar


J. Zhang et al., “Realistic optical cell modeling and diffraction imaging simulation for study of optical and morphological parameters of nucleus,” Opt. Express, 24 (1), 366 –377 (2016). OPEXFF 1094-4087 Google Scholar


Y. Wen et al., “Quantitative analysis and comparison of 3D morphology between viable and apoptotic mcf-7 breast cancer cells and characterization of nuclear fragmentation,” Plos One, 12 (9), e0184726 (2017). POLNCL 1932-6203 Google Scholar


W. Jiang et al., “Comparison study of distinguishing cancerous and normal prostate epithelial cells by confocal and polarization diffraction imaging,” J. Biomed. Opt., 21 (7), 071102 (2016). JBOPFO 1083-3668 Google Scholar


L. Yang, X. Hu and Y. Feng, “Stereological and laser scanning confocal microscopic analysis of 3-dimensional morphology of melanoma cells,” Acta Opt. Sin., 32 (9), 198 –205 (2012). GUXUDC 0253-2239 Google Scholar


A. E. Ekpenyong et al., “Study of 3D cell morphology and effect on light scattering distribution,” Proc. SPIE, 7367 73671J (2009). PSISDG 0277-786X Google Scholar


J. Q. Lu et al., “Analytic modeling of 3-d structure of biologic cells using a Gaussian random sphere method,” in Biomedical Optics and 3-D Imaging, (2010). Google Scholar


W. Jiang et al., “Study of 3D structural differences between CD4+ and CD8+ T lymphocytes,” in Biomedical Optics, BS3A.78 (2014). Google Scholar


X. T. Su et al., “Light scattering characterization of mitochondrial aggregation in single cells,” Opt. Express, 17 (16), 13381 –13388 (2009). OPEXFF 1094-4087 Google Scholar


A. Janowskawieczorek et al., “Microscope-based label-free microfluidic cytometry,” Opt. Express, 19 (1), 387 –398 (2011). OPEXFF 1094-4087 Google Scholar


X. Su et al., “Label-free and noninvasive optical detection of the distribution of nanometer-size mitochondria in single cells,” J. Biomed. Opt., 16 (6), 067003 (2011). JBOPFO 1083-3668 Google Scholar


X. Lin et al., “Cell light scattering characteristic numerical simulation research based on FDTD algorithm,” Proc. SPIE, 10245 102450F (2017). PSISDG 0277-786X Google Scholar


X. Lin et al., “Light scattering from normal and cervical cancer cells,” Appl. Opt., 56 (12), 3608 –3614 (2017). Google Scholar


S. T. Moghaddam et al., “Effect of the probe location on the absorption by an array of gold nano-particles on a dielectric surface,” J. Quant. Spectrosc. Radiat. Transfer, 197 106 –113 (2017). JQSRAE 0022-4073 Google Scholar


C. Haspel and M. Tzabari, “Sensitivity tests on the convergence tendency of the scattering order formulation of the discrete dipole approximation,” Appl. Opt., 56 (12), 3547 –3555 (2017). APOPAI 0003-6935 Google Scholar


Y. Jiang et al., “Label-free detection of aggregated platelets in blood by machine-learning-aided optofluidic time-stretch microscopy,” Lab Chip, 17 2426 –2434 (2017). LCAHAM 1473-0197 Google Scholar


C. L. Chen et al., “Deep learning in label-free cell classification,” Sci. Rep., 6 21471 (2016). SRCEC3 2045-2322 Google Scholar


A. Mahjoubfar, C. L. Chen and B. Jalali, Artificial Intelligence in Label-free Microscopy: Biological Cell Classification by Time Stretch, Springer Publishing Company, Incorporated, Cham, Switzerland (2017). Google Scholar


Y. Yin and E. Gelenbe, “Single-cell based random neural network for deep learning,” in IEEE Int. Joint Conf. on Neural Networks (IJCNN), (2017). Google Scholar


R. S. Brock et al., “Effect of detailed cell structure on light scattering distribution: FDTD study of a B-cell with 3D structure constructed from confocal images,” J. Quant. Spectrosc. Radiat. Transfer, 102 (1), 25 –36 (2006). JQSRAE 0022-4073 Google Scholar


C. E. Shannon, “A mathematical theory of communication,” ACM SIGMOBILE Mobile Comput. Commun. Rev., 5 (1), 3 –55 (2001). Google Scholar


R. C. Gonzalez, R. E. Woods and S. L. Eddins, Digital Image Processing Using MATLAB, 795 –857 Prentice Hall, Pearson Education Inc., New Jersey (2003). Google Scholar


S. U. Lee, S. Y. Chung and R. H. Park, “A comparative performance study of several global thresholding techniques for segmentation,” Comput. Vision Graphics Image Process., 52 (2), 171 –190 (1990). Google Scholar


Lu Zhang is an associate professor at Xi’an Jiaotong University, China. She received her bachelor’s degree in mechanical engineering in 2002. She received her PhD and master’s degrees in instrument science and technology from Xi’an Jiaotong University in 2010 and 2006, respectively. As a visiting scholar, she did the scattering research for small particles at the National University of Singapore in 2013. Her current researches are mainly focused on bio-optical detections for label free cells and small particles.

Biographies for the other authors are not available.

© 2018 Society of Photo-Optical Instrumentation Engineers (SPIE) 1083-3668/2018/$25.00 © 2018 SPIE
Lu Zhang, Yunhao Xie, Yingzhe Tu, Lele Luo, Kaixing Li, Li Yuan, Wei Chen, Hong Zhao, and Zhenxi Zhang "Clinical lymphocytes construction for light scattering inversion study: a three-dimensional morphology constructed method from defective confocal images," Journal of Biomedical Optics 23(8), 085003 (15 August 2018).
Received: 27 March 2018; Accepted: 30 July 2018; Published: 15 August 2018

Back to Top