Breast magnetic resonance imaging (MRI) has gradually gained much popularity in clinical use because results have shown that the screening accuracy of MRI is significantly higher than that of mammography and ultrasound.1 Currently, doctors generally rely on breast MRI for obtaining the region of tumor since it is usually an important sign of breast cancer for diagnosis. Based on these considerations, this study proposes a new scheme that adopts mathematical algorithms from multispectral image processing techniques for specific object contrast enhancement. The tumor region can be segmented from contrast-enhanced images and shown as a binary image. We anticipate that the generated binary tumor region images will aid doctors in clinical diagnosis.
Over the years, many computer-assisted methods have been developed for analyzing single-spectral MRI, such as principal component analysis (PCA),2 eigenimage analysis,3 neural networks,4 and fuzzy c-means (FCMs).5 Eigenimage analysis has been shown to be effective in segmentation and feature extraction, and neural networks have been found to perform well in segmenting brain tissues and have been compared with classical maximum likelihood methods. However, because multispectral images provide more information for processing or analysis, multispectral analysis techniques can be used to improve the performance. Hence, several methods have been developed for processing multispectral MRIs, such as orthogonal subspace projection (OSP)6 and Kalman filter,7 but both of them require prior knowledge. With these considerations, we have developed a new method called the independent component texture analysis (ICTA) to segment the tumor region in multispectral breast MRIs. ICTA comprises three techniques: independent component analysis (ICA), entropy-based thresholding (ET), and texture feature registration (TFR). Among them, ICA, originally, is a blind source separation (BSS) method in the signal processing field, and it is a powerful tool for feature extraction and data representation such as speech recognition, image recognition, and statistical analysis.8
The proposed method initially assumes multispectral breast MRIs to be gray-level values in a three-dimensional space composed of several independent components (ICs) that can be regarded as different tissues of the breast such as fat, glands, tumor mass, and muscle. First, the ICA technique is used to separate the ICs. Second, the binary images that indicate the suspicious tumor region are generated using the ET technique. Finally, texture feature extraction is employed to find the consistency of the tumor texture feature in suspicious tumor regions, which is called TFR. The texture features adopted for feature description are called the texture spectrum (TS), which is based on the varying relationship between the gray levels of both image pixels and surrounding pixels. We divided the TS according to three feature descriptors named black-white symmetry (BWS), geometric symmetry (GS), and degree of direction (DD).9 According to the experimental results, the three feature values may effectively reflect differences between tumors and normal tissues. The binary image of the tumor region selected by TFR is the output of proposed ICTA method that could assist doctors in their diagnosis. A flowchart of the proposed ICTA is shown in Fig. 1. The performance of ICTA is compared with that of principal component texture analysis (PCTA), FCM, constrained energy minimization (CEM), and OSP methods using a set of breast MRIs to evaluate the feasibility of this new method in medical and clinical applications.
The remainder of this paper is organized as follows: Sec. 2 presents the existing multispectral image blind separation technique, ICA. Section 3 describes in detail the proposed method, ICTA. Section 4 explains the experiments and their results. Finally, the conclusions are presented in Sec. 5.
Independent Component Analysis
ICA has been developed to solve BSS problems such as the cocktail party problem, and it is an extension of the covariance-based PCA method. The observed signals are considered to be a linear combination of the original signals and a mixing matrix. The goal is to find the mixing matrix. In this paper, we applied the ICA technique to separate multispectral breast MR images of different tissues. First, let us define an -dimensional original signal denoted as a vector . Through linear transformation, we obtain an -dimensional observed signal denoted as a vector . We assume that the linear transformation is composed of a mixing matrix of size and the original signal
For simplicity, we rewrite the above equation as follows:
Currently, many algorithms have been developed for the implementation of ICA, but most of them either require complex computation or have slow convergence. In this paper, we applied the fast fixed-point algorithm (FastICA)10 proposed by Hyvarinen and Oja for the effective implementation of ICA. The principal advantages of this algorithm are fast convergence and simple computation.
Independent Component Texture Analysis
Because ICs generated by ICA are inconsistent and cannot identify tissue automatically, this paper proposes ICTA, which combines ICA, ET, and TFR, to cope with the aforementioned problems of ICA and accordingly determine the target tumor region from ICs. The following sections describe ET and TFR in more detail.
In ICTA, ET (Refs. 11 and 12) is first used to segment suspicious regions from an IC. For a start, we let be the (, )’th element of a co-occurrence matrix that considers the gray-level transitions between two adjacent pixels. We define it as
The probability of a transition from gray level to is obtained as6) into four quadrants, , , , and , as shown in Fig. 2.
These four quadrants can be further grouped into two classes. We assume that pixels with gray levels above the threshold are assigned to the foreground (objects) and those equal to or below the threshold are assigned to the background. Quadrants and correspond to local transitions within the background and foreground, respectively, whereas quadrants and represent transitions across boundaries between the background and foreground. The probabilities associated with each quadrant are then given by
Three definitions—local entropy, joint entropy, and global entropy—can be derived on the basis of the cell probabilities, each of which yields a different method. According to experimental results, the threshold obtained from the local entropy is better than that obtained from the joint and global entropies. Therefore, we focused on the local entropy in this study.
Because quadrants and contain local transitions from background to background (BB) and objects to objects (FF), respectively, the local entropy of BB, denoted by , and the local entropy of FF, denoted by , can be defined as11 as
Texture Feature Registration
After ICs are segmented by ET, the TS (Ref. 9) is then applied to extract texture features from the segmented region (suspicious region) for identifying the optimum IC. TS is intended for feature description based on the varying relationship between the gray levels of the image pixels and the surrounding pixels. It has shown high efficiency in tissue discrimination. The feature value (TS) calculated from the suspicious region is then compared with the value calculated from a proven tumor region to define its probability and determine the most probable IC, and so is referred to as “TFR.” In TFR, TS is subdivided into three feature descriptors named BWS, GS, and DD,9 which are described as follows.
A group of vectors is defined for the pixel of which represents the gray level of the mask central pixel and represent the gray levels of the surrounding eight points. The relationship between the central pixel and the surrounding eight pixels is
The surrounding eight pixels are assigned letters a to h clockwise, as illustrated in Fig. 3. Using the TS, it is possible to define the following texture features that represent the textures of images:
For the implementation of TFR, the tumor regions of T1, T2, and PD were first identified by experienced radiologists and then the TS was used to extract the texture features from these known tumor regions. Different sections in cases were utilized to obtain the reference tumor texture features. Table 1 shows the texture feature mean values extracted from the proven tumor regions.
Mean value of tumor texture features.
|Black-white symmetry||Geometric symmetry||Degree of direction|
In this section, the performances of CEM, OSP, FCM, PCTA, and the proposed ICTA are evaluated with breast MRI datasets.
In total, 16 cases of breast MRIs were acquired from Tri-Service General Hospital in Taiwan for performance evaluation, of which 11 cases contain tumor and five cases without tumor. The MRIs were performed on a 1.5T MAGNETOM Vision Plus system (Siemens, Erlangen, Germany). One demonstrated case which contains a medium size tumor is selected as an example and shown in Fig. 4 with four different sequences (bands): PD-weighted spectral image acquired with , T1-weighted spin-echo image acquired with , T2-weighted spin-echo image acquired with , and T1_FS (T1-weighted fat-saturated image). The resolution and size of each band are 8-bit gray level and , respectively. The slice thickness of all MRIs is 2 mm.
In each case, the standard tumor region required for performance evaluation was conformably verified by three experienced radiologists as shown in Fig. 5(d). In Fig. 5, Fig. 5(a)–5(c) shows the contours of the tumor mass delineated by three experienced radiologists, and Fig. 5(d) is the result of the intersection of Fig. 5(a)–5(c).
Abundance percentage thresholding method
In order to quantitatively study and compare the results with different methods, we converted the abundance fractional images generated by the different methods to binary images. Hence, we adopted the method proposed in Ref. 13, which used the abundance fraction percentage as the cutoff threshold value for such a conversion. First, using the normalized abundance fraction of the image with the range of [0, 1], let be the pixel vector of the image and be the estimated abundance fractions of in ; then the normalized abundance fraction of each estimated abundance fraction can be obtained by
Receiver operating characteristic curve analysis
Using the thresholding method, we were able to calculate the number of detected pixels in the generated fractional abundance image. Then the performance indices were calculated using receiver operating characteristic (ROC) analysis.14 We define as interesting objects to be classified. is the total number of pixels specified by the ’th object signature , is the number of pixels specified by the ’th object signature and actually detected as , and is the number of false-alarm pixels that are not specified by the object signature but are detected as . Using the definitions of , , and , we further define the detection rate , false alarm rate , mean detection rate , and mean false rate as follows:22) is the average of the detection rates for all detected objects; similarly, the mean false-alarm rate as defined by Eq. (23) is the average of the false-alarm rates for all detected objects. According to Eqs. (20) and (21), each fixed can generate a pair of and . Furthermore, increasing from 0% to 100% gradually can generate a set of pairs . A two-dimensional ROC curve of is then plotted, and the area size under the ROC curve (AUC) is measured as a performance index (classification rate).
The experimental results obtained by the traditional ICA method are shown in Table 2, where the highest classification rates are given in bold face. In Table 2, four IC and four IC’ (negative film of IC) values are generated in 10 run times. As seen in Table 2, the highest classification rates did not appear in the same IC in each run time. Therefore, the classification rates would not be high as shown in the last row if we chose a fixed IC as the classification result. Table 3 presents the mean values of the 10 highest classification rates manually selected from ICs in 100 run times for three cases with different tumor sizes (big, medium, and small). From the results of Table 3, we can see that the performance of the ICA method was better than the PCA method, but both of them were unable to identify the tumor region by employing a fixed IC.
Tumor correct-classification rates of ICA for a case. IC 1’ represents the negative film of IC 1, and so forth.
|Run times||IC 1 (%)||IC 2 (%)||IC 3 (%)||IC 4 (%)||IC 1’ (%)||IC 2’ (%)||IC 3’ (%)||IC 4’ (%)|
Tumor classification rates of ICA and PCA for three demonstrated cases with different tumor sizes (big, medium, and small), by mean values of 10 highest classification rates in 100 run times.
|Methods||Case 1 (big) (%)||Case 2 (medium) (%)||Case 3 (small) (%)|
The texture features calculated from the suspicious tumor region for each IC were then compared with the reference tumor texture features to find out the most probable ICs according to their Euclidean distance calculated as
Table 4 shows the tumor classification rates for all IC and IC’ values of the three cases using traditional ICA, and the minimum distances are given in bold face. From Table 4, we can see that ICs with minimum distance will have highest classification rate. Such a result also indicates that correct ICs could be found by using TFR. Table 5 shows the correct IC identification rates of TFR for 16 cases, of which 11 cases contain tumor and five cases without tumor. According to experimental experience, the result of a case will be identified as no tumor within if all the distances of ICs are .
Comparison between classification rate and distance defined in Eq. (27) for three demonstrated cases by using ICA.
|Method||Case 1(big)||Case 2 (medium)||Case 3 (small)|
|Distance||Tumor classification rates (%)||Distance||Tumor classification rates (%)||Distance||Tumor classification rates (%)|
Correct IC identification rates by using texture feature registration (TFR) calculated in 100 run times for 16 cases (11 contain tumor and five without tumor).
|IC identification rates (%)|
|Correct-classification rate 92.09|
|False-alarm rate 6.36|
Figure 6 shows high-contrast images resulting from ICTA, PCTA, CEM, and OSP methods, where the PCTA method has the same procedure with ICTA, but using PCA instead of ICA. Figure 7 shows ROC curves for the classified sections shown in Fig. 6. Table 6 presents the area under the ROC curves for ICTA, PCTA, CEM, and OSP. Figure 8 shows the segmentation results of applying ICTA, PCTA, CEM, and OSP on the images shown in Fig. 4. In addition, we add an FCM into Fig. 8 for comparison because it is a common representative in classification. Table 7 shows the averaged tumor correct-classification and false-alarm rates obtained from applying ICTA, PCTA, FCM, CEM, and OSP in our experimental data set. From Tables 6 and 7, we can see that ICTA has good performance with lowest false-alarm rate, as does CEM. But unlike CEM, which requires prior knowledge, ICTA is a blind classification technique.
Area under ROC curve (RD versus RF) for ICTA, PCTA, CEM, and OSP.
|Methods||Case 1 (big)||Case 2 (medium)||Case 3 (small)|
|Blind source separation|
|Prior knowledge required|
Averaged tumor classification rates for ICTA, PCTA, FCM, CEM, and OSP.
|Method||Tumor classification rates|
|Correct-classification rate (%)||False-alarm rate (%)|
|Blind source separation method|
|Prior knowledge required method|
Although ICA shows good performance in multispectral MRI analysis, it may produce inconsistent results for ICs because ICA uses random initial projection vectors. To solve this problem, we propose a new method called the ICTA for tumor contrast enhancement and segmentation using breast MRIs. ICTA consists of three processes: ICA, ET, and TFR.
After comparison with PCTA, FCM, CEM, OSP, and contrast-injected breast MRIs, our results indicate the possibility of using ICTA for accurate diagnosis. First, ICTA is a BSS method that, unlike CEM or OSP, does not require prior knowledge. Second, the correct IC identification rate by TFR is as high as 92.09%. Third, the tumor region correct-classification rate is as high as 95.78% with a 2.05% false-alarm rate. We anticipate that the high-contrast and binary images generated by ICTA will assist radiologists in breast MRI screening and increase the accuracy of breast tumor diagnosis.
The work was supported by the National Science Council, Taiwan, under the Grant Nos. NSC100-2221-E-167-027 and NSC101-2221-E-167-036. The authors would like to thank Dr. Hsian-He Hsu, Department of Radiology, Tri-Service General Hospital in Taiwan, for providing cases.
Sheng-Chih Yang received an MS degree in computer and information science from Knowledge System Institute (KSI), Illinois, USA, in 1996 and PhD degree in electrical engineering from National Cheng-Kung University (NCKU), Tainan, Taiwan, in 2006. From 1996 to 2005, he worked as a lecturer at the Department of Electronic Engineering, National Chin Yi University of Technology (NCUT), and has been an associate professor at the Department of Computer Science and Information Engineering since 2006. His research interests include image processing and biomedical image processing. He is currently the director of the Computer Center of National Chin Yi University of Technology.
Chieh-Ling Huang received a BS degree in electrical engineering from National Taiwan University of Science and Technology (NTUST), Taiwan, in 1998, and MS and PhD degrees in electrical engineering from National Cheng Kung University (NCKU), Taiwan, in 2000 and 2008, respectively. He is currently an assistant professor at the Department of Computer Science and Information Engineering, Chang Jung Christian University (CJCU). His current research interests are image processing, video image analysis, and radio frequency identification (RFID) technology. He is a member of Phi Tau Phi honor society.
Tsai-Rong Chang received a BS degree in electrical engineering from National Taipei University of Technology (NTUT), Taiwan, in 1997, and MS and PhD degrees in electrical engineering from National Cheng Kung University (NCKU), Taiwan, in 1999 and 2005, respectively. He is currently an assistant professor at the Department of Computer Science and Information Engineering, Southern Taiwan University of Science and Technology (STUST). His current research interests are artificial neural networks, bioinformatics, and image processing. He is a member of Phi Tau Phi honor society.
Chi-Yuan Lin received a BS degree in electronic engineering from National Taiwan university of Science and Technology (NTUST), Taiwan, in 1988, the MS degree in electronic and information engineering from National Yunlin University of Science and Technology (NYUST), Taiwan, in 1998, and the PhD degree in electrical engineering from National Cheng Kung University (NCKU), Taiwan, in 2004. Since 1983, he has been with the Department of Electronic Engineering at National Chi Yi University of Science and Technology in Taiwan, where he is now an associate professor. His research interests include neural networks, multimedia coding, data hiding, and image processing.