Photodynamic therapy (PDT) is a widely used dermatological treatment based on photodynamic reactions. A light-sensitive substance (i.e., photosensitizer) and a light source with a specific wavelength are used to kill targeted cells.22.214.171.124.–6 The safety and effectiveness of PDT primarily depend on irradiance, tissue oxygenation, light penetration, and local photosensitizer concentration.7,8 The optimal light dosage for PDT should adequately yield lethal effects on the targeted tumor while minimizing damage on adjacent normal tissues.9
Common adverse effects of PDT include various degrees of pain and a burning sensation. Pain level increases with irradiance; however, the exact pain mechanism remains unclear.10 Significant advances in light dosimetry studies of PDT have been obtained for in vivo propagation models, which correlate incident irradiance and physiological outcomes in biological materials.11,12 However, light dosimetry is hardly controllable in vivo because of irregularly shaped lesions, segmentation difficulty in normal areas, the patient’s movement during the treatment, and so on.
Various light sources can be used in PDT; these sources include lasers, solid-state light-emitting diodes (LEDs), gas discharge lamps, and incandescent filament lamps.13 Conventional light delivery systems comprise a light source and a light diffuser to homogeneously illuminate target areas. Several types of light diffusers have been developed for topical use or for application in body cavities.1415.16.17.–18 Despite their wide applications, diffusers exhibit limited abilities to adjust for complex surfaces.14 Expanded beams or coupling fibers are used to deliver healing light and achieve a homogenous irradiance.19,20 However, irradiance on lesions remains uneven following parallel-beam irradiation because of the curved surface of the human body. Integrating spheres have been introduced to improve PDTs for skin diseases; the procedure principally focuses on evaluation instead of illumination.21
Image processing technology is often combined with PDT treatment and used in site-specific delivery and in the planning, assessment, and monitoring of PDT.2223.–24 The introduction of imaging technologies can affect the current practice of PDT.25 For dermatological PDT, image processing is used to segment lesions according to color information because skin diseases are often accompanied by external morphological changes. Proper segmentation can be used to guide light delivery systems.
This study proposes a three-step treatment procedure for PDT. First, the three-dimensional (3-D) morphology of an irregular lesion is reconstructed by structured light. This procedure allows the lesion to be divided into small patches that are assumed to be internally homogeneous. Then, the patches are classified by color and distance using the superpixel method. Finally, the desired light dosage on the target can be achieved by modifying the gray value of the pixels in the projector.
Materials and Methods
Demo System Design
A fast structured light system consisting of a camera (Nikon D50, Tokyo, Japan), a computing unit, and a projector (Sony VPL-DX11, Kōnan Minato, Tokyo, Japan) was implemented to obtain a 3-D model of a lesion in Fig. 1(a). The projector was used as the space modulator in 3-D reconstruction and then as the light source during treatment. The software process is shown in Fig. 1(b), and the flow path is introduced in the following sections.
Data Acquisition and 3-D Reconstruction
The system should be calibrated to determine the parameters of the camera and the projector [C&P, Fig. 1(b)], which included rotation and translation matrices between them, as well as the calibration parameters of the lens in the C&P. A 3-D scanning of the head model was obtained by a series of structured light patterns (e.g., gray code). Images were simultaneously taken from another angle. The coding and decoding of the gray code, which indicate the corresponding relation of the pixels on the image plane, is shown in Fig. 2. Each 3-D coordinate was indexed from its two-dimensional (2-D) coordinates on the camera image plane.26 Hence, the texture of the 2-D image can be mapped onto the 3-D point cloud to form a 3-D model for observation and further operation.
Segmentation and Rating of Lesion
Setting the desired irradiance pixel by pixel remains difficult. Topical segmentation and classification in dermatology depend on the morphological changes of skin lesions, which vary with the disease. A superpixel clustering method was proposed for segmentation and rating under different situations.27 First, an original image was transformed to the LAB color space , and parameter was set to correspond to the number of areas that require treatment. The pixels were then clustered by their distances in the five-dimensional space along with their corresponding coordinates around the initial center pixel of , as given by Eq. (1)
Some of the main concerns related to using projectors as illumination sources include irradiation alignment and incident angle calculation; the latter was essential for targeted and homogeneous irradiances in the lesion. A simplified illumination model is demonstrated in Fig. 3. and represent the coordinates of the camera and projector, respectively, is the image plane, and is the projector plane. Given the known 3-D coordinates of the skin diseases, the mapping relation from the image plane coordinate to the projector coordinates can be described as follows:4)
The target irradiance for a practical voxel can be achieved by modifying the gray value of the projection image. For example, the pulse width of modulation in a digital light projector was linearly correlated with the irradiance. The gray value of the corresponding pixel was then calculated upon setting the desired irradiance. An example of a reverse projection image is shown in Fig. 4.
3-D Reconstruction and Evaluation
The 3-D reconstruction and evaluation with a resolution of in the , , and axes is illustrated in Fig. 5. The head model was reconstructed by a 3-D scanner (3D CaMega, Boweihengxin Ltd., Beijing, China) for reference. Figure 5(a) shows and 345,170 vertices that were obtained from our reconstruction in the left (in brown) and right (in black) with abbreviations of 3-D Sca. and 3-D Rec., respectively. The 3-D point clouds were evaluated by MeshLab. Figure 5(b) shows that the Hausdorff distances were in most of the vertices and that the gross errors were almost in the boundary with no points in our 3-D reconstruction because of the shadow.
The clustering results for different and skin diseases are revealed in Figs. 6 and 7, respectively. The original image of Fig. 6 is a phantom of a port-wine stain (PWS), where the red region represents the lesion. The number of segmentations increased with . This result indicates that segmentation is a flexible and convenient clustering method because the threshold or initial conditions need not be set. Zhang27,28 demonstrated that segmentation can be evaluated by various techniques and that segmentation applications can be considered during selection. Common empirical methods were used to test the segmentation quality in all four experiment groups (Table 1).29,30 UM is the intraregion uniformity measurement, GC is the gray-level contrast between regions, VC is the interregion vergence contrast, MI(k) is the rate of pixels that should be segmented when they are not with the proposed algorithm, and MII(k) is the rate of pixels that should not be segmented. MI(k) and MII(k) were obtained by comparing the experimental results with the theoretical results by manual specification.
Evaluation of the segmentation by different properties.
|Uniformity measurement||Gray-level contrast||Vergence contrast||MI(k)a||MII(k)b|
MI(k) is the rate of pixels that should be segmented when they are rejected by the proposed algorithm.
MII(k) is the rate of pixels that should not be segmented when they are accepted by the proposed algorithm.
The severities of skin disease are often hierarchical. For instance, the severity of PWS is graded in six levels. The head model was painted with common colors (e.g., purple, dark violet, light red, and dark red) for demonstration.31 The areas with different colors were clustered separately (Fig. 8). The expected light dosimetry can be mapped from the camera plane to the projector plane as described in Sec. 2.4.
Given the 3-D reconstruction of the lesion, we can estimate the surface normal at each patch by its surrounding neighbors and their gravity. The cosines of the incident angles of each patch on the surface with five discrete levels for simplicity are shown in Fig. 9. Only one third of the incident rays are nearly vertical to the surface. Thus, even illumination can hardly be obtained on a curved lesion illuminated directly by a flat source.
Internal points can be regarded as the interpolation of boundary points. Thus, the difference between the lesion and the reverse projection can be assessed by the degree of boundary matching. The red region in the left of Fig. 6 represents the targeted lesion. The highlighted areas in Fig. 10 were illuminated to verify the correctness of the reverse projection or treatment illumination. The incidence was well targeted, and the normal areas were protected without any additional work. The borders were matched on the lesion, which verified the accuracy of the segmentation and reconstruction.
Considering the limitations of the experimental conditions and clinical trials, we verified the following parameters:
Spectrum of Light Source
Monochromatic light is the optimal choice in PDT, but LED and other nonlaser light sources are also widely used. The depth of light penetration into the tissue is related to the light spectrum. Although projectors are often based on lamps, laser and LED light engines are used in high-brightness projectors. LED or laser projectors can be used with the right color channel, or the light engine can be modified with a correct laser source. Two or three color channels can also be combined by different laser types, which are beneficial in simultaneously treating diseases at different depths.
The power density required for PDTs is typically 70 to . Light sources with power outputs of 5 to 10 W are suitable for most treatments; several modules are also available. For example, Luminus developed an LED chip PT-120 for a TI DLP® light engine with 5400 lumen at 525 nm. Laser light engines possess a green laser module DSG265 that provides a digital projection of up to 35 W. For the modulator in the projector, the DMD9500 datasheet exhibits a threshold density of up to in the visible spectrum. This threshold density corresponds to 48 W for the device, which meets PDT requirements. The proposed digital illumination procedure allowed modulation either by modulating the light source or by modifying the gray value of the pixel.
The head model painted with different colors verified the correctness of the reverse projection. Although color is a characteristic of lesions, its identification requires professional clinical diagnosis. 3-D reconstruction and segmentation provided a convenient control for treatment, for example, by making the treatment area larger than the lesion-defined area, reserving a specific untreated area, or illuminating different areas at various levels.
Optical Parameters of Human Skin
Optical parameters (e.g., specular reflection, absorption coefficient, scattering coefficient, photosensitizer absorption, and the index of refraction) vary from person to person. These parameters are related with thermal damage, pain, and treatment evaluation; hence, optimal protocols in the site are highly difficult. All parameters should be achieved and used to calibrate the gray value of the illumination image for the treatment to provide an accurate and ideal PDT. Protocols of different wavelengths or modes of light modulation can be simultaneously assessed on the same patient to understand the mechanism of PDT.
Patient Movement During the Treatment
Patient movement during PDT is too difficult to avoid because of the treatment time and pain. PDT is tiring because it takes per session. Moreover, the procedure can be very excruciating due to various levels of pain and burning sensations. The proposed procedure allows 3-D reconstruction of the lesion at timed intervals as prescribed by a doctor. Then, the result can be registered and aligned with the original 3-D model. Thus, each treatment dosimetry can be not only reserved but also statistically analyzed and compared.
The 3-D reconstruction and the hierarchical segmentation of the lesion were introduced into PDT for dermatological treatment. Parameters such as distance from the light source to the target treatment voxel, angle between the normal vectors of lesion patch and the incident light, lesion level, and so on can be achieved and classified. These parameters can yield a controllable light dosimetry for complex lesions on curved surfaces, and specific treatment procedures can be performed with less manual labor by doctors.
Moreover, 3-D lesion reconstruction can also help plan PDT treatments and evaluate the outcome of different treatment sessions to potentially standardize light delivery.
This work is supported by the Science Foundation of Beijing Institute of Technology (20131642009) and National Science Foundation of China (30900385).
Xiao-ming Hu received his BS degree in physical electronics from Beijing Institute of Technology (BIT) in 2001 and received his PhD degree in optical engineering from BIT in 2006. He has been working at the School of Life Science in BIT since then. His research interests include biomedical photonics, piezosurgery, and optical detection in microfluidics.
Feng-juan Zhang received her BS degree from School of Automatic, Zhengzhou University in 2013 and is a candidate for the M S degree in biomedical engineering of BIT. Her research interests include biomedical photonics and three-dimensional (3-D) reconstruction.
Fei Dong received his BS degree in mechanics from Wuhan University in 2010 and his MS degree in optical engineering from BIT in 2014. His research interests include machine vision and 3-D reconstruction.
Ya Zhou received her PhD degree in optical engineering from BIT in 2000. After two years of postdoctoral research at School of Earth and Space Sciences, Peking University, she joined BIT as an associate professor in 2002. Her research interests include biometrics technology, medical image analysis, and computer vision.