|
1.IntroductionAutomatic defect classification (ADC) is a wafer fabrication process that classifies defects into predefined types, e.g., particle, scratch, etc. Figures 1 and 1 show examples of a particle and scratches, respectively. By correctly classifying the defects, the cause of the defects can be analyzed, and this information is used for improving the process and consequently the yield. Hence, there have been many studies on ADC. For example, Kameyama and Kosugi:1 proposed a method that exploits a hyperellipsoid clustering network (HCN) with radial basis function (RBF) and model switching. Also, smart beam search (SBS) using a support vector machine (SVM) was proposed for feature selection.2 However, there are some difficulties in applying conventional appearance-based pattern classification methods (e.g., techniques used in face detection3) to ADC, because defects in the same class have too many variants in their shapes. Also, since the defect regions occupy very small portions of the image, the global feature statistics (e.g., frequency or filter bank responses) are useless. To resolve these difficulties, we propose a new method based on classification-after-segmentation. The most essential part of the process may be the correct segmentation of defects. Due to the shrinking bias problem,7 however, the conventional state of the art segmentation methods based on maximum a posterior Markov random fields (MAP-MRF) with a Potts model data term4, 5, 6 often oversegment a scratch (thin object) into several objects, and thus a scratch can appear as particles. For dealing with this problem, we propose a new MAP-MRF based segmentation method. To be specific, we develop a new energy function for the MAP-MRF scheme based on the Retinex theory8 for handling the blurry scratches and the color inconsistency. After segmentation, we define several features (shape, intensity, and so on) for each defect, and develop an AdaBoost classifier to tell whether the patch corresponds to a particle or other defects (including scratch). In the experiments, we show that our segmentation method reduces the oversegmentation of scratches and thus keeps the false alarm rate low, even for high particle detection rates. 2.SegmentationAmong the many segmentation methods, the state of the art MAP-MRF approach is adopted here.4, 5, 6 That is, segmentation is achieved by minimizing an energy function: where is a set of sites, is an eight-neighborhood system, is a label of the site , and . The label indicates that the site belongs to the segment whose label is . Specifically, the data term is designed so that pixels having similar intensity values are clustered into a single segment:where is the intensity of a given pixel , and denotes the difference of intensity between the adjacent labels. is called the smoothness term, defined aswhere is a constant and is defined asin conventional works.5, 6 enforces the continuity of labels by penalizing label discontinuities. However, it is well known that since the tries to minimize the length of boundary9 (shrinking bias), this method often segments a long and thin object into several parts. Also, blurred boundaries deteriorate the performance of (especially when capturing thin objects). Hence, many long and thin objects in wafer images are frequently segmented into several parts, and they are often confused with particles.To prevent oversegmentation, we develop a new function to be included into the data term: where is a Retinex filtering of input.8 To be specific, the for our purpose is defined aswhere is a Gaussian blurred image at pixel , and is a predefined parameter (in our implementation, is 0.9). Note that the Retinex filtering compensates for the blurring at the image formation process, and improves color consistency caused by illumination change.8 Therefore, and means that and have the same intrinsic colors [even if ], and the labels satisfying should be penalized. In summary, alleviates the shrinking bias by penalizing the discontinuities occurring on the pixels having the same intrinsic colors. A similar idea can also be found in the binarization of document images.10 Finally, the smoothness term in Eq. 1 is given bywhere and are two balancing parameters.3.ClassificationSince each particle and scratch is segmented into a single region by the proposed segmentation algorithm, we can use several features extracted from the segments to determine whether it is a particle defect or not. 3.1.FeaturesLet be a set of positional vectors in a given segment, be the size of , and be the pixel intensity at . Then features can be summarized as follows. Mean intensity: Shape descriptor: where and are two eigenvalues of the covariance matrix of (when the value is close to unity, the shape has no directional preference, and means that the shape is a thin and elongated one).Texture measure: where ’s are eigenvalues of the covariance matrix of the vectors at points ,The vector in Eq. 11 is computed over and the covariance matrix of these vectors is found. Then, Eq. 10 is defined as the measure of texture, which has a large value when there exists a particular directional texture.Measure of orientation bias (of edges): obtained from the histogram of By computing the orientation histogram and summing the sizes of four dominant bins, we can measure the bias of orientation distribution.3.2.AdaBoostFor machine learning using the extracted features, we use the AdaBoost algorithm, where each weak classifier is based on the log-likelihood ratio test where indicates the output of segmentation in the feature space, denotes the weighted histogram of the ’th feature for a positive sample, and is similarly defined. Then, after the training process, a strong classifier is given bywhere, from the standard AdaBoost algorithm,11 is determined by the function of current error rate :4.Experimental ResultsThe dataset for the experiment consists of defected images acquired by a bright field inspection instrument ( ⟨100⟩ oriented silicon wafer, magnification of more than times). Among the dataset, we use 380 images including particle defects and 150 images including scratch defects as training samples. Then we test 200 images containing particle defects and 200 images having no particle defects (of course they contain other defects such as scratch defects). As can be seen in Fig. 1, 1, 1, 1, the proposed term improves segmentation performance. The main purpose of ADC is to automatically classify the particle from the other kinds of defects (mostly scratches), hence we evaluate the performance of ADC using the detection ratio (DR) of particle defects and the false alarm (FA) of other defects considered as particle, which are defined as In typical detection problems, if we try to increase the DR, the FA also increases and vice versa. Hence the performance of classifier or detector can be measured by the receiver operating characteristic (ROC) that shows the DR versus FA. When the FA is kept low for the high DRs, the detector is considered to be a good one. We compare the ROCs before and after applying our new method in Fig. 2 , where it can be observed that our method keeps the DR very high even for very low (down to 0.05) FA rates.5.ConclusionIn this work, we propose a new approach to ADC based on the classification-after-segmentation framework. The wafer image is first segmented based on the MAP-MRF approach, where a new energy function is designed to prevent the degeneration of scratch into several regions. Then, an AdaBoost classifier is trained using the features extracted from the segments. According to the experimental results on wide variants of particles, the proposed approach shows good classification performance. AcknowledgmentsThis research was supported by the Ministry of Culture, Sports and Tourism (MCST), and the Korea Culture Content Agency (KOCCA) in the Culture Technology (CT) Research and Development Program 2009. referencesK. Kameyama and Y. Kosugi,
“Semiconductor defect classification using hyperellipsoid clustering neural networks and model switching,”
3505
–3510
(1999). Google Scholar
P. Gupta, D. Doermann, and D. DeMenthon,
“Beam search for feature selection in automatic svm defect classification,”
212
–215
(2002). Google Scholar
P. Viola and M. Jones,
“Rapid object detection using a boosted cascade of simple features,”
511
–518
(2001). Google Scholar
Y. Boykov, O. Veksler, and R. Zabih,
“Fast approximate energy minimization via graph cuts,”
IEEE Trans. Pattern Anal. Mach. Intell., 23
(11), 1222
–1239
(2001). https://doi.org/10.1109/34.969114 Google Scholar
Y. Boykov and M. Jolly,
“Interactive graph cuts for optimal boundary and region segmentation of objects in n-d images,”
105
–112
(2001). Google Scholar
C. Rother, V. Kolmogorov, and A. Blake,
“grabcut: interactive foreground extraction using iterated graph cuts,”
309
–314
(2004). Google Scholar
S. Vicente, V. Kolmogorov, and C. Rother,
“Graph cut based image segmentation with connectivity priors,”
1
–8
(2008). Google Scholar
E. L. Land,
“The retinex theory of colour vision,”
Scientific Am., 237
(6), 108
–128
(1977). https://doi.org/10.1038/scientificamerican1277-108 Google Scholar
V. Kolmogorov and Y. Boykov,
“What metrics can be approximated by geo-cuts, or global optimization of length/area and flux,”
564
–571
(2005). Google Scholar
M. Pilu and S. Pollard,
“A light-weight text image processing method for handheld embedded camera,”
547
–556
(2002). Google Scholar
R. E. Schapire,
“The boosting approach to machine learning: an overview,”
149
–172
(2002). Google Scholar
|