Cell function correlates strongly with structure or morphology. For example, cellular activities such as differentiation and apoptosis can be distinguished by changes in morphology. Consequently, morphological features provide powerful and often critical markers for cell assay and clinical applications.1,2 Because of the complexity in cell morphology, conventional microscopy methods have to be used, which are labor-intensive for data acquisition and analysis. Therefore, it is highly desired to develop an automated method for rapid assay of large populations of single cells about their morphology with flow cytometry technology. Conventional and commercially available flow cytometers, however, are designed to acquire fluorescence signals or images as the major source of information for rapid cell assay. This approach, however, provides very limited information on cell morphology. The three-dimensional (3-D) morphology and molecular polarization information of single cells have been shown to correlate strongly with the spatial distribution of scattered light from the cell illuminated by highly coherent light.220.127.116.11.–8 We have previously developed a flow cytometry method for rapid acquisition of cross-polarized diffraction image pairs with two cameras.910.11.12.–13 The new method, termed as polarization diffraction imaging flow cytometry (p-DIFC), has been shown to be capable of distinguishing cell lines of high similarity in their 3-D morphology.10
Despite the capacity for morphology-based cell assay, a significant problem still exists that affects performance of the p-DIFC method using conventional CCD cameras. The images of the cells are acquired under the flow condition, which could markedly reduce the image contrast by motion blur (MB) with these cameras. The image blurring makes it harder to perform accurate image analysis and cell assay. A time-delay-integration (TDI) imaging method can be applied to control and reduce the MB. A TDI camera has multiple lines of pixels whose charges are transferred at a speed controlled with an external clock pulse-train. If the charge transfer speed of pixel lines is equal to the speed of the moving image, MB can be eliminated.14 A TDI camera has been developed and used to investigate the effect of MB on characteristic parameters extracted from cross-polarized diffraction images of microspheres and biological cells using different image-processing algorithms.15
In this report, we focus our attention on the quantitative analysis of the MB in measured diffraction images in the frequency domain with the modulation transfer function (MTF). The MTF-based analysis enables us to validate a tool for numerically “blurring” diffraction images acquired with the matched speeds between line transfer and moving image in p-DIFC measurements, and investigate the effect of MB on pattern analysis of the images from the same cell. We have also proposed a single parameter of frequency modulus for quantification of MB based on the Fourier transform of the measured diffraction images. The MB analysis was carried out on measured diffraction images acquired with MCF-7 and K562 cells moving at seven different speeds. These results provide insights into the effect and evaluation of MB to further improve the p-DIFC method with the TDI camera, and allow the use of the average frequency modulus to assess MB quantitatively.
Motion Blur Assessment
We designed and developed a TDI-camera-based imaging system for variation and elimination of MB in the acquired diffraction images from the moving cells.15 Quantitative assessment of MB is needed to characterize blurring in diffraction images. Often, a spatial domain image analysis approach is used for blur assessment in conventional image data. But the diffraction images concerned here carry light scattering noise, and the frequency domain approach with MTF becomes more suitable for MB assessment.
MB could occur when the object moves relative to the imaging sensor. In this study, the diffraction images from the moving object are acquired at off-focus position to improve image contrast.16,17 A diffraction image acquired at an off-focus position with MB can be described in frequency domain by its spatial frequency spectrum as17 Our purpose here is to analyze the effect of MB given by the modulus of from the measured diffraction images and quantify MB with a TDI camera as the imaging sensor.
The degree of MB can be determined from the distance and orientation of the image’s movement on the image sensor during an exposure time . For our study, the cell and its image on the camera sensor move along the -direction (see Fig. 2), while the incident beam propagates along the -axis. Therefore, the degraded image in terms of incident light energy can be expressed as integration of a series of light rays shifting through different positions of or1819.–20 Figure 1 presents four cases of calculated by Eq. (5) for imaging systems with TDI cameras and different mismatch ratios, and a comparison to a system with a conventional CCD camera of the same image speed and equivalent exposure time. These results show quantitatively that the TDI camera can reduce and eliminate MB effectively and produce images of larger bandwidths than those acquired with conventional CCD cameras.
Figure 1 shows that the MB can be eliminated by synchronization at with a TDI camera, and the remains maximized at 1 for all frequencies. Once the mismatch ratio starts to increase, MB occurs with the values of markedly reduced in the frequency domain. We can quantify the frequency decrease of a blurred image to evaluation of the degree of MB by an averaged modulus of its Fourier transform , defined as
Polarization Diffraction Imaging Flow Cytometry System With One Time-Delay-Integration Camera
Figure 2 shows the p-DIFC system constructed for this study based on previous research.10,12,21 A cw laser of 532 nm in wavelength (MGL-III-532-100 mW) is focused by two cylindrical lenses on the core fluid in an elliptical spot with major diameter of about 300 μm along the -axis and minor diameter of about , and the polarization and power of the incident beam are controlled by one half-wavelength plate and one Glan prism. The coherent side-scatter by the illuminated cells is collected by an infinity-corrected, nontelecentric objective lens (378-805-3, Mitutoyo), followed by a Wollaston prism (LSP-3A14, Laser Institute, QFNU) of aperture. The p-polarized and s-polarized scattered light after the Wollaston prism, separated by 10 deg in directions, are focused with a tube lens of focal length onto the TDI-CCD sensor (S10201-4 Hamamatsu). The imaging system can be translated along the -axis toward the flow chamber from the focused position of at which the core fluid is on the object plane of the imaging system.
Different from conventional CCD cameras, the TDI cameras allow synchronization between the cell speed and line-pixel transfer frequency as discussed above. To determine cell speed, we measured the flow rate of the sheath fluid, which is proportional to the cell speed 22 and can be controlled by the sheath fluid pressure. The line-pixel transfer frequency of the TDI camera was set to be 16.67 KHz with an in-house developed software. Given the number of pixel lines of the TDI-CCD sensor as 128 and the sensor height as 1.536 mm, the synchronous image speed can be calculated from
We used polystyrene microspheres of diameter and a conventional CCD camera (Lumenera Lt225) of a 6-mm height () sensor for flow-speed measurement. The shadow lengths of the imaged microspheres, proportional to the exposure time, were used to determine the speed of microspheres. The exposure time of the conventional camera was set to 3 ms, so the image speed can be determined by
For the objective and tube lens of focal length , the magnification of the imaging system () is given by 18.75, and the microspheres’ speed or core-fluid speed is given by
After sample injection into the core-fluid reservoir, the particle or the core-fluid speed was adjusted by the sheath fluid pressure and measured by the shadow lengths. For three different speed settings, five measurements were performed to obtain the averaged core-fluid speed with an interval of 20 min between measurements. The averaged values and standard deviations show that the maximum relative change is 2%, which indicates that the flow speed was stably controlled.
Diffraction Image Acquisition
After the measurement of flow speed with microspheres, two cancer cell lines were used to investigate the effect of MB on diffraction images. The human breast carcinoma cell line MCF-7 and chronic myelogenous leukemia cell line K562 (ATCC, Manassas, Virginia) were chosen for this study due to their large difference in morphological structures. The cells were maintained in the RPMI 1640 culture medium supplemented with 10% fetal bovine serum. The adherent MCF-7 cells were detached from culture flask with trypsin-EDTA to prepare suspension cell samples in culture medium before each measurement. Cross-polarized diffraction images of the cells were acquired at the off-focus position of with seven different flow speeds.
Simulated Motion Blur in Diffraction Images
To accurately investigate the effect of MB on cell classification, it is highly desired to obtain diffraction images with different degrees of MB from the same cell. This is very difficult, if not impossible, to achieve in p-DIFC measurements, because no two cells are identical even if they belong to the same type. For this purpose, we applied an existing filtering algorithm in MATLAB® (7.2, MathWorks) with simulated MB in diffraction images acquired with a TDI camera under the condition of zero speed-mismatch ratio or . The applied MATLAB® algorithm (fspecial) convolutes an input image with a kernel for window-smoothing the input image over a length of pixels along a specified direction.
Results and Discussion
The MB similarly affects the different polarized diffraction images. The raw diffraction images from the TDI camera were cropped to obtain pixels near the maximum pixel of each polarized diffraction image for analysis. Figures 3(a) and 3(b) present examples of p-polarized diffraction images acquired at three different values of core-fluid speed with one TDI camera and similar images with a conventional CCD camera of exposure time and . It is clear that the diffraction images acquired with the TDI camera at or show severe degradation due to MB, which is also the case for the one acquired with a conventional CCD camera. In contrast, the images acquired with the TDI camera at the zero speed-mismatch ratio of display minimal blur. Figure 3(c) further presents two diffraction images with numerically simulated MB using different values of for pixel numbers of window-smoothing along the vertical direction on the TDI-acquired image shown in Fig. 3(a). One can observe that the two related images in Figs. 3(b) and 3(c) with versus pixels or versus 48 pixels present similar MB even though they were acquired from different cells.
To analyze the p-polarized diffraction images in the frequency domain, 2-D Fourier transforms were performed on to obtain , and the results of normalized by the central peak or DC component are shown in Fig. 4 with the vertical -axis corresponding to the vertical -axis of motion in images of Fig. 3. Since the Fourier components are concentrated in the low-frequency range or the central region, the spectral images in Fig. 4 present only the middle part of the 2-D frequency image with pixels and values of central peaks as 255. Comparison of the images in Figs. 4(a) and 4(b) indicates clearly that MB reduces the frequency information along the -axis in frequency domain and agrees well with the MTF analysis. The results of frequency analysis of the p-DIFC image data acquired with the TDI camera can also be compared with those acquired with the conventional CCD camera in Fig. 4(a), which shows that larger frequency band or information can be obtained with the TDI camera than with the conventional CCD. Furthermore, comparison of the spectral images in Figs. 4(b) and 4(c) proves that the simulated MB on diffraction images acquired with produces distributions in frequency space similar to those in measured images with . It should be noted that the similarity is achieved with the images acquired from different cells of K562 or MCF-7. These results validate a very useful tool to accurately model the effect of MB on image patterns and cell classification with polarized diffraction images acquired with a TDI camera. A study is underway with this tool to investigate the effects of MB on GLCM parameters extracted from the diffraction images of cells acquired under the condition of zero speed-mismatch.
In addition to the modulus image , one can also quantify MB by a single parameter of averaged frequency modulus defined in Eq. (6). The mean values and standard deviations of were obtained from five randomly selected p-polarized images of pixels at different values of core-fluid speed and are plotted in Fig. 5(a). In the same figure, we also plot the same modulus parameter versus core flow speed from the images obtained with simulated MB performed on those images acquired with zero speed-mismatch by window-smoothing over pixels. It can be seen that both the mean values and standard deviations of spectral amplitude reduce with the increased speed-mismatch, which significantly affects the accuracy of pattern analysis for cell assay and classification. The high similarity between the two sets of curves of diffraction images acquired with a TDI camera at different core flow speed and those by simulated MB shows further that the simulated MB can be used for analysis of MB using only the diffraction images acquired with zero speed-mismatch. We note that the conventional blur evaluation parameter of averaged gradient does not perform well in the case of diffraction images presented in this study. The parameter is typically defined by the following for a given image along the direction of MB or -axis18Fig. 4 are less than 2 pixels and are not sensitive to the speed-mismatch ratio, because the central peak is dominated by the DC noise, which can be observed from the images of plotted in log-scale for in Fig. 4.
Finally, it is interesting to examine whether the MB can be effectively removed by deconvolution. For this purpose, a MATLAB® function (deconvwnr) was applied to the measured diffraction images to perform Wiener-filter-based deconvolution. The deconvolution function requires appropriate selection of three parameters of pixel-smoothing length , direction of motion in degree from the horizontal direction of the blurred image, and value of as the noise-signal-power-ratio (NSPR) to achieve best effect of deblur. The optimized results of deconvolution are shown in Fig. 6 by applying the MATLAB® function on the blurred images acquired with a flow speed of and as presented in Fig. 3(b). One can clearly see that even with the optimized parameters of deconvolution, the MB cannot be fully removed if the speed-mismatch becomes large. Furthermore, the deconvolution calculations are computationally expensive and are difficult to apply for rapid image analysis required in p-DIFC method.
A diffraction imaging method and system with one TDI camera has been developed for acquisition of diffraction images of flowing cells. We performed MTF analysis of the measured diffraction images from two different cancer cell lines and validated a numerical method for the simulation of motion-blurring effects on images acquired with zero speed-mismatch. These results show that the MTF analysis provides an accurate approach for characterization of the MB effect on diffraction images and significant insights on improvement of image analysis by eliminating blur with a TDI camera. We further show that the averaged modulus of a diffraction image in the frequency domain yields a much improved single parameter than does the averaged gradient calculated directly from the diffraction image for the quantification of MB.
The authors would like to thank Dr. Fu Zheng of TJMU for preparing the MCF-7 and K562 cell samples. X. H. Hu acknowledges support by the Tianjin Science and Technology Commission and Y. Feng acknowledges support by the NSFC (Grant Nos. 81171342 and 81201148).
K. A. Kilian et al., “Geometric cues for directing the differentiation of mesenchymal stem cells,” Proc. Natl. Acad. Sci. U. S. A. 107, 4872–4877 (2010).http://dx.doi.org/10.1073/pnas.0903269107Google Scholar
S. Holler et al., “Two-dimensional angular optical scattering for the characterization of airborne microparticles,” Opt. Lett. 23, 1489–1491 (1998).OPLEDP0146-9592http://dx.doi.org/10.1364/OL.23.001489Google Scholar
J. Q. Lu, P. Yang and X. H. Hu, “Simulations of light scattering from a biconcave red blood cell using the finite-difference time-domain method,” J. Biomed. Opt. 10, 024022 (2005).http://dx.doi.org/10.1117/1.1897397Google Scholar
M. H. Maleki, A. J. Devaney and A. Schatzberg, “Tomographic reconstruction from optical scattered intensities,” J. Opt. Soc. Am. A 9, 1356–1363 (1992).JOAOD60740-3232http://dx.doi.org/10.1364/JOSAA.9.001356Google Scholar
J. Neukammer et al., “Angular distribution of light scattered by single biological cells and oriented particle agglomerates,” Appl. Opt. 42, 6388–6397 (2003).APOPAI0003-6935http://dx.doi.org/10.1364/AO.42.006388Google Scholar
A. N. Shvalov et al., “Individual Escherichia coli cells studied from light scattering with the scanning flow cytometer,” Cytometry 41, 41–45 (2000).CYTODQ0196-4763http://dx.doi.org/10.1002/1097-0320(20000901)41:1<41::AID-CYTO6>3.0.CO;2-NGoogle Scholar
Y. Feng et al., “Polarization imaging and classification of Jurkat T and Ramos B cells using a flow cytometer,” Cytometry 85, 817–826 (2014).1552-4922http://dx.doi.org/10.1002/cyto.a.22504Google Scholar
J. Zhang et al., “Analysis of cellular objects through diffraction images acquired by flow cytometry,” Opt. Express 21, 24819–24828 (2013).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.21.024819Google Scholar
H. Wang et al., “Acquisition of cross-polarized diffraction images and study of blurring effect by one time-delay-integration camera,” Appl. Opt. 54, 5223–5228 (2015).APOPAI0003-6935http://dx.doi.org/10.1364/AO.54.005223Google Scholar
R. C. Gonzalez and R. E. Woods, Digital Image Processing, 3rd ed., Prentice Hall, Upper Saddle River (2007).Google Scholar
D. L. Angwin, H. Kaufman, Chapter 7 in Digital Image Restoration, and A. K. Katsaggelos, ed., Springer-Verlag, New York (1991).Google Scholar
He Wang received his BS degree in biomedical engineering at Shandong University in 2010. His current research interests include biological cell imaging and development of TDI cameras.
Changrong Jin received his BS degree in biomedical engineering at Hebei University of Technology in 2013. His current research interests include microscope imaging and visualization of biological information.
Yuanming Feng is a professor of biomedical engineering at Tianjin University. His research interests include diffraction imaging flow cytometry and measurement technique of radiation-induced apoptosis.
Dandan Qi received her BS degree in biomedical engineering at the Hebei University of Technology in 2013. Her current research interests include diffraction imaging and morphology of biological cells.
Yu Sa received his BS and PhD degrees from Tianjin University, and he is a lecturer in the Department of Biomedical Engineering of Tianjin University. His research interests include instrument development, diffraction imaging, and computational fluid dynamics modeling studies.
Xin-Hua Hu received his BS and MS degrees from Nankai University, Tianjin, China, in 1982 and 1985, an MS degree in physics from Indiana University in 1986, and a PhD in physics in 1991 from the University of California at Irvine. He joined the physics faculty in 1995 and is currently a professor at East Carolina University. His main research interests relate to the investigations of light scattering and their applications in probing tissues and cells.