Polarization imaging is becoming an emerging technique for studies in material,1,2 astronomy,3 remote sensing,4,5 and biomedicine.67.8.–9 When observing the biomedical and material specimens, polarization microscope is a useful tool to reveal their optical anisotropic nature and can provide abundant microstructural information about samples. The traditional polarization microscope adopts a polarizer to provide linear polarized illumination, and an analyzer is inserted for observation in cross- or parallel-polarized light mode, which is simple to implement but difficult for quantitative analysis.10 Oldenbourg et al.11 modified the traditional polarization microscope by adopting the liquid crystal retarders. The modified microscopy greatly improves the analytic power, providing quantitative birefringence distributions of thin specimens, such as the mitotic spindle isolated from the fertilized sea urchin egg.11 Recently, Arteaga et al.12 proposed a Mueller matrix microscope based on two continuous rotating wave plates to completely extract the polarization property of a specimen. In this scheme, the intensity at each pixel is analyzed by digital demodulation of thousands of continuously captured frames.12 The polarization microscopes based on liquid crystal retarders and rotating wave plates are division of time technologies, which are suitable for stationary samples. For the polarization measurements of dynamic processes, however, division of the focal plane (DoFP) polarimeters can be adopted. For a microgrid polarizer DoFP polarimeter, an array consisting of numerous differently orientated pixel-size micropolarizers is fixed on the imaging sensor.1314.–15 Several recent studies have incorporated the DoFP polarimeter into a microscope for simultaneous Stokes vector imaging.13,16 Liu et al.13 developed a complementary fluorescence-polarization microscope using a DoFP polarimeter to enable real-time video rate polarization imaging without any moving parts. Hsu et al.16 presented a polarization microscope using an infrared full-Stokes imaging polarimeter. The DoFP polarimeter has the same instrument size as the conventional image sensor and can capture the Stokes vector images in a single shot.
Recently, polarization imaging techniques have been used as potential tools for biomedical diagnosis, such as the detection of abnormal tissues in skin,17,18 liver,19,20 esophagus,21 colon,22,23 cervix,24 bladder,25 and so on.2627.–28 Nowadays, the cancer incidence is growing fast worldwide, making pathological diagnoses time-consuming. Basically, during a diagnosis process, the pathologists need about half an hour to prepare the stained frozen slices of suspicious tissue samples from the patients. With careful observations using a transmission microscope, the pathologists need to provide quick assessments which are crucial for the surgeons. Compared to the diagnosis using the standard dewaxed slices cut from fixed tissues in paraffin specimens, the quick assessments always lead to a small portion of misdiagnose. In our experiments, we find that when using a DoFP polarimeter for polarization imaging of pathological tissue slices, the experimental results can provide additional useful information but will sometimes be confusing and misleading if the illumination state of polarization (SoP) and the sample are not well matched. For different illumination SoPs, there will be considerable differences in the specimen’s Stokes vector images. In this situation, measuring the sample’s Mueller matrix is conducive to our understanding of the sample’s comprehensive polarization property. Moreover, it is also found that when applied to the thin dewaxed slices of tissues, the intrinsic anisotropic fibrous structures of the cancerous tissues are more prominently highlighted in the Mueller matrix elements related to the circularly polarized light, or the elements in the fourth row and column. Hence, a DoFP polarimeter-based microscope capable of measuring the Mueller matrix may provide useful information of human carcinoma tissue slices.
In this article, we propose an optimal 4-SoP illumination scheme for the Mueller matrix measurement using a DoFP-based polarization microscope. The experimental results show that the polarization features of the unstained human carcinoma tissue slices are more prominently reflected in the Mueller matrix elements and . It is also indicated that the pathological microstructures are less visible in the polarization images under illumination by the linear polarization light, but can be enhanced by “polarization staining” under illumination by a circularly polarized light. As a nonstained technique, the DoFP-based polarization microscope can provide additional microstructural information of both standard and frozen pathological slices, which may be used as a potential tool for the quick diagnosis of human carcinoma tissues.
Methods and Materials
Polarization Imaging Using the Division of Focal Plane Polarimeter
We use the DoFP polarimeter “PolarCam” (4D Technology Inc.) whose sensor size is and whose video frame rate can reach to 110 fps.15 The diagram of the pixelated micropolarizer array is shown in Fig. 1(a). Four pixels with different polarization orientations comprise a super pixel, which are combined together to calculate the linear part of the Stokes vector29 For accurate Stokes vector measurement, the nonuniformities for all pixels should be calibrated. We introduce light with different known SoPs and measure the instrument responses to obtain the instrument matrix of the polarimeter.30 Using the obtained instrument matrix, we can calculate the Stokes vector using the polarimetric data reduction method. For each super pixel as shown in Fig. 1(a), the polarimetric measurement can be expressed as 31 In addition, we reduce the edge artifacts32 and increase the spatial qualities of the Stokes vector images by a bilinear interpolation on the raw intensity images. For the DoFP polarimeter, the instrument matrices for every super pixel are different, and the Stokes vector computation in Eq. (2) is usually time-consuming. For example, for the construction of -sized Stokes vector images, the computation takes about 16 s when running in MATLAB® R2014a with an Intel core i5-4460 CPU. However, using a GTX 780 graphics processing unit (GPU) card and algorithm we reduce the computation time of the same image to 0.047 s in double-precision calculation, which makes it feasible for online video rate visualization of Stokes vector images.
The degree of linear polarization (DoLP) and angle of polarization (AoP) can be obtained from the Stokes vector33 In real applications, polarization staining with only DoLP and AoP generates satisfactory effects. The mapping strategy is shown as follows: Fig. 1(b) and is easy to identify by the human vision system. It avoids the influence of the light intensity variation and focuses on the visualization of polarization properties.
Design of the Division of Focal Plane Polarimeter-Based 3 × 4 Mueller Matrix Microscope
The configuration of the DoFP polarimeter-based Mueller matrix microscope is shown in Fig. 2. The original light source and the imaging sensor are replaced with the polarization states generator (PSG) and the DoFP polarimeter, respectively. In the PSG, the polarizer (Thorlabs) is fixed, thus no matter what SoP the light emitting diode (LED, Cree, 630 nm) irradiance is, the light passing through the polarizer will be linearly polarized with a constant light intensity. Measuring all columns of a Mueller matrix needs at least four illuminations with independent SoPs. The wave plate (Thorlabs) is rotated to four angles to produce the SoPs. For each illumination, the Stokes vector images of the specimen are calculated using the single-frame image of the DoFP polarimeter. The ’th (, and 4) measurement is described as31 However, a 131.8-deg wave plate is not commercially available and requires a custom order, which might influence the instrument’s accuracy. Thus, we adopt the commonly used quarter-wave plate and search the minimum CN of  using the genetic algorithm integrated in the MATLAB® optimization toolbox. Calculation shows when the retardance of the wave plate is 90 deg, and the fast axes of the wave plate are set to (, , 15.12 deg, and 51.69 deg) or (, , 38.31 deg, and 74.88 deg), the CN of reaches to the minimum 3.40. The above angle scheme yields four elliptical SoPs, which are not commonly used and studied. Thus, alternatively, we set two fast axes and to and 45 deg to generate the left- and right-hand circularly polarized light, respectively, and optimize the remaining fast axes, and , by minimizing the CN of . As shown in Fig. 3, when and (or ), the CN reaches to a local minimum 3.677, which is close to the optimal value 3.40. [Although the CN can reach 3.599 when and , we choose (, , 19.6 deg, and 45 deg) scheme for a faster measurement speed.]
After the optimization of , the propagation of errors in Mueller matrix construction is minimized. However, for accurate measurement, the nonideal nature of the polarizing elements should be calibrated. The nonideal nature of the polarizing elements includes the rotation errors of the polarizer and the quarter-wave plate, and the retardance error of the quarter-wave plate. The calibration of the DoFP polarimeter-based Mueller matrix system includes the calibration of the DoFP polarimeter and calibration of the matrix . Because the DoFP polarimeter has already been calibrated, we only need to calibrate the matrix . When the sample is removed from the polarization microscope and the wave plate is rotated to four different angles (, , 19.6 deg, and 45 deg), the first three rows of the matrix will be directly measured by the DoFP polarimeter, and the three errors can be calculated. The calibration shows that the real retardance of the quarter-wave plate used in this study is 90.98 deg. After the optimization and calibration of the matrix , the mean errors for all the Mueller matrix elements reach to about 0.3% and 0.6% when measuring the Mueller matrices of the air and a linear polarizer, respectively.
Cancerous Tissue Samples
Cancer incidence is growing fast worldwide, making the pathological diagnoses of different cancer tissues crucial tasks. Using a conventional microscope, the features of carcinoma tissues are usually visible for stained slices but invisible for unstained ones. However, when observing the unstained slices using polarization imaging techniques, we can obtain abundant useful polarization information to distinguish the normal and abnormal tissues. To test the potential power of the DoFP polarimeter-based Mueller matrix microscope, in this study, we apply it to human liver and cervical carcinoma tissue samples.
Figure 4 shows the carcinoma tissue slices provided and prepared by Shenzhen Sixth People’s Hospital. The slice shown in Fig. 4(a2) is a thick hematoxylin–eosin (H–E) stained human liver carcinoma slice, and the slice shown in Fig. 4(a1) is the corresponding unstained, dewaxed thick slice from the same biopsy sample archived in the hospital. The slice shown in Fig. 4(b2) is a thick H–E stained human cervical carcinoma slice, and the slice shown in Fig. 4(b1) is the unstained, dewaxed thick slice from the same biopsy sample. Because the two slices shown in Figs. 4(a1) and 4(a2) [and in Figs. 4(b1) and 4(b2)] are originally “twins” adjacent to each other, the cancerous areas should look similar. The microscopic images of the H–E stained slices are shown in Figs. 4(a3), 4(a4), 4(b3), and 4(b4). Many fibrous structures are visible across both slices, and the stained colors of the dysplastic regions are darker than that of healthy tissues. The microscopic images of the unstained, dewaxed thick slices are shown in Figs. 6(a1) and 6(b1), respectively. From these images, we can see that the characteristic microstructures represented in the H–E stained slices are invisible in the unstained ones. This work was approved by the Ethics Committee of the Shenzhen Sixth People’s (Nanshan) Hospital.
Results and Discussion
3 × 4 Mueller Matrix Images of Unstained, Dewaxed Human Carcinoma Specimens
In order to test the potential diagnostic applications of the DoFP polarimeter-based polarization microscope, we measure the Mueller matrix images of different regions of both the unstained, dewaxed slices of human liver cancer specimen as shown in Figs. 6(a1) and 6(b1) and human cervical carcinoma specimen as shown in Figs. 6(c1) and 6(d1). Figures 5(a)–5(d) show the Mueller matrix images of the unstained pathological samples. The fibrous structures can hardly be seen in the intensity images shown in Figs. 6(a1)–6(d1), but are significantly enhanced in the Mueller matrix images as shown in Fig. 5. Some previous studies have testified that the developments of the liver cancer cells are often accompanied by inflammatory reactions, leading to fibrosis formations in the surrounding tissues. During the pathological process from hepatitis to cirrhosis and liver cancer, the proportion of fibrous structures rises.20 Therefore, the fibrosis degree can serve as a quantitative indicator for the detection and scoring of liver carcinoma tissues. It can be observed from the Mueller matrix elements shown in Fig. 5 that the proportion of fibrous structures in the area represented by Fig. 5(b) is higher than that represented by Fig. 5(a). On the other hand, the cervical carcinoma processes usually lead to breaking down of the well-aligned anisotropic structures in healthy cervix tissues, which can be used as diagnostic indicators from different cervical intraepithelial neoplasia stages to cervical cancer.27 As indicated by the Mueller matrix elements shown in Fig. 5, the breakdown level of the well-aligned anisotropic structures in the area represented by Fig. 5(d) is higher than that represented by Fig. 5(c). It can be clearly observed from Fig. 5 that the intrinsic anisotropic fibrous structures of the cancerous liver and cervical tissues are mainly revealed in the and elements. Meanwhile, in other Mueller matrix elements, the microstructures are not significant or are even invisible, which are different from the characteristic features of Mueller matrices of bulk tissues measured in the reflection mode.7 When measuring a bulk tissue, the strong scattering power usually leads to a Mueller matrix with prominent patterns in all the elements. Hence, for the biomedical polarimetry in vivo, the Mueller matrix imaging is appropriate. However, for the standard thin dewaxed human carcinoma tissue slices with limited scattering, the Mueller matrix images can provide more important pathological information than linear polarized Mueller matrix images.
The Mueller matrix can completely describe the polarization property of a specimen, but its physical meaning is not easy to understand. The diattenuation of a sample is a function of the first row of the Mueller matrix. For the thin carcinoma slice, the values of diattenuation are often very small. Since the diagonal , , and are close to one, we can safely assume that the samples are almost nondepolarizing. For the nondepolarizing samples, the linear retardance () and its orientation angle () can be derived as
The value and orientation of the birefringence effect can be proven as potentially crucial information for pathologists. Since the tissue slices are usually very thin, their values of retardance are always small, resulting in more prominent values in the and than those in other elements. The small retardance is mostly induced by the microfibers in the tissue slices.19
Single Shot “Polarization Staining” Using Circularly Polarized Light Illumination
From the Mueller matrix images in Fig. 5, we can conclude that the and elements containing important structural information may be useful for the diagnosis of some kinds of pathological tissues. For the (, , 19.6 deg, and 45 deg) measurement scheme, when the fast axis of the wave plate is rotated to 45 deg and , the illumination light is right- and left-hand circularly polarized, respectively. For instance, under right-hand circularly polarized light illumination, the following equation can be obtained:
Considering that the Mueller matrix elements , , and are close to zero as shown in Fig. 5, the following approximation can be obtained:Figs. 6(a2)–6(d2), in which the information of and are encoded. Compared with the intensity images shown in Figs. 6(a1)–6(d1), the polarization staining images reveal much more detailed information of the microstructures, especially the pathological-related fibrosis with strong birefringence. The values of DoLP, as well as the color saturation of the polarization image of the fibrosis region, will be higher than the background. In addition to the value of the DoLP, the alignment orientations of the microfibers can also be clearly revealed from polarization staining images.
The color images of the H–E-stained slices and the polarization staining images of the unstained slices are based on different imaging contrast mechanisms. Therefore, the differences between the results shown in Fig. 4 and 6 are significant. Compared with Fig. 4, the anisotropic fibrosis structures in Fig. 6 are more prominent than other types of microstructures, meaning that the polarization imaging technique can be used to reveal the optical anisotropic nature of tissue samples in pathological assessments. The polarization staining imaging using circularly polarization light has several unique advantages: (a) many previous works have pointed out that the polarization imaging techniques are capable of providing additional structural information of the samples, especially information about structures smaller than the diffraction limit2627.–28 and (b) the use of circularly polarized light illumination can avoid the orientation influence of the linearly or elliptically polarized light illuminations on the anisotropic microstructures widely existing in biological tissues.
Because both the intensity and the polarization staining images are obtained with single frames, using GPU acceleration algorithm, the DoFP polarimeter-based polarization microscope has the capacity for real-time polarization monitoring of dynamic processes such as living cell behaviors. Similarly, the use of the DoFP polarimeter and circularly polarized light illumination may make the implementation of the real-time polarization endoscope possible, too.
In this article, a DoFP polarimeter-based polarization microscope capable of simultaneously measuring both the Stokes vector and the Mueller matrix with an optimal 4-SoP illumination is presented. We test the polarization microscope by measuring unstained human cancerous tissue slices. The experimental results show that the characteristic microstructures represented in the H–E-stained slices are invisible in the unstained ones. However, from the Mueller matrix images, we can see that the fibrous structures are highlighted. The intrinsic anisotropic fibrous structures of the cancerous liver and cervical tissues are mainly revealed in the and elements. Meanwhile, in other Mueller matrix elements the microstructures are not significant or even invisible. The characteristic features of the and can be observed in the polarization staining images using the circularly polarized light as illumination. In this way, combined with GPU acceleration algorithm, the DoFP polarization microscope has the capacity for real-time polarization imaging of biomedical specimens to aid in clinical diagnosis.
This work has been supported by the National Natural Science Foundation of China Grant Nos. 11174178, 11374179, 61205199, and 61405102 and the Science and Technology Project of Shenzhen Grant Nos. CXZZ20140509172959978 and GJHZ20150316160614844.
F. Snik et al., “An overview of polarimetric sensing techniques and technology with applications to different research fields,” Proc. SPIE 9099, 90990B (2014).http://dx.doi.org/10.1117/12.2053245Google Scholar
E. Namer, S. Shwartz and Y. Y. Schechner, “Skyless polarimetric calibration and visibility enhancement,” Opt. Express 17(2), 472–493 (2009).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.17.000472Google Scholar
N. Ghosh and I. A. Vitkin, “Tissue polarimetry: concepts, challenges, applications, and outlook,” J. Biomed. Opt. 16(11), 110801 (2011).JBOPFO1083-3668http://dx.doi.org/10.1117/1.3652896Google Scholar
S. Alali and A. Vitkin, “Polarized light imaging in biomedicine: emerging Mueller matrix methodologies for bulk tissue assessment,” J. Biomed. Opt. 20(6), 061104 (2015).JBOPFO1083-3668http://dx.doi.org/10.1117/1.JBO.20.6.061104Google Scholar
B. Kunnen et al., “Application of circularly polarized light for non-invasive diagnosis of cancerous tissues and turbid tissue-like scattering media,” J. Biophotonics 8(4), 317–323 (2015).http://dx.doi.org/10.1002/jbio.v8.4Google Scholar
R. Weaver, “Rediscovering polarized light microscopy,” Am. Lab. 35(20), 55–61 (2003).Google Scholar
O. Arteaga et al., “Mueller matrix microscope with a dual continuous rotating compensator setup and digital demodulation,” Appl. Opt. 53(10), 2236–2245 (2014).APOPAI0003-6935http://dx.doi.org/10.1364/AO.53.002236Google Scholar
Y. Liu et al., “Complementary fluorescence-polarization microscopy using division-of-focal-plane polarization imaging sensor,” J. Biomed. Opt. 17(11), 116001 (2012).JBOPFO1083-3668http://dx.doi.org/10.1117/1.JBO.17.11.116001Google Scholar
V. Gruev, R. Perkins and T. York, “CCD polarization imaging sensor with aluminum nanowire optical filters,” Opt. Express 18(18), 19087–19094 (2010).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.18.019087Google Scholar
W. Hsu et al., “Polarization microscope using a near infrared full-Stokes imaging polarimeter,” Opt. Express 23(4), 4357–4368 (2015).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.23.004357Google Scholar
E. Du et al., “Mueller matrix polarimetry for differentiating characteristic features of cancerous tissues,” J. Biomed. Opt. 19(7), 076013 (2014).JBOPFO1083-3668http://dx.doi.org/10.1117/1.JBO.19.7.076013Google Scholar
Y. Wang et al., “Differentiating characteristic microstructural features of canceroustissues using Mueller matrix microscope,” Micron 79, 8–15 (2015).MICNB20047-7206http://dx.doi.org/10.1016/j.micron.2015.07.014Google Scholar
A. Pierangelo et al., “Multispectral Mueller polarimetric imaging detecting residual cancer and cancer regression after neoadjuvant treatment for colorectal carcinomas,” J. Biomed. Opt. 18(4), 046014 (2013).JBOPFO1083-3668http://dx.doi.org/10.1117/1.JBO.18.4.046014Google Scholar
T. Novikova et al., “The origins of polarimetric image contrast between healthy and cancerous human colon tissue,” Appl. Phys. Lett. 102, 241103 (2013).APPLAB0003-6951http://dx.doi.org/10.1063/1.4811414Google Scholar
N. T. Clancy et al., “Polarised stereo endoscope and narrowband detection for minimal access surgery,” Biomed. Opt. Express 5(12), 4108–4117 (2014).BOEICL2156-7085http://dx.doi.org/10.1364/BOE.5.004108Google Scholar
V. Sankaran, Jr. J. T. Walsh and D. J. Maitland, “Comparative study of polarized light propagation in biologic tissues,” J. Biomed. Opt. 7(3), 300–306 (2002).JBOPFO1083-3668http://dx.doi.org/10.1117/1.1483318Google Scholar
C. He et al., “Characterizing microstructures of cancerous tissues using multispectral transformed Mueller matrix polarization parameters,” Biomed. Opt. Express 6(8), 2934–2945 (2015).BOEICL2156-7085http://dx.doi.org/10.1364/BOE.6.002934Google Scholar
P. G. Ellingsen et al., “Mueller matrix three-dimensional directional imaging of collagen fibers,” J. Biomed. Opt. 19(2), 026002 (2014).JBOPFO1083-3668http://dx.doi.org/10.1117/1.JBO.19.2.026002Google Scholar
Z. Chen, X. Wang and R. Liang, “Calibration method of microgrid polarimeters with image interpolation,” Appl. Opt. 54(5), 995–1001 (2015).APOPAI0003-6935http://dx.doi.org/10.1364/AO.54.000995Google Scholar
R. Chipman, Handbook of Optics, Vol. I, 3rd ed., McGraw-Hill, New York (2009).Google Scholar
J. S. Tyo, “Design of optimal polarimeters: maximization of signal-to-noise ratio and minimization of systematic error,” Appl. Opt. 41(1), 619–630 (2002).APOPAI0003-6935http://dx.doi.org/10.1364/AO.41.000619Google Scholar
B. M. Ratliff, C. F. LaCasse and J. S. Tyo, “Interpolation strategies for reducing IFOV artifacts in microgrid polarimeter imagery,” Opt. Express 17(11), 9112–9125 (2009).OPEXFF1094-4087http://dx.doi.org/10.1364/OE.17.009112Google Scholar