One of the most challenging problems is detecting dim targets in complex optical images. Here, the term “dim” means low contrast. The classic method for determining the target’s presence is to employ a spatially matched filter (MF) on the zero-mean image of interest and to compare positive and negative exceedances to a threshold. As expected, the filter is designed for a specific target profile and a statistically known background clutter. In digital imagery, the signal-to-noise ratio (SNR) gain from this procedure is equal to the number of independent samples composing the profile of the target. Unfortunately, this may not be enough gain to trigger the detection of a target while minimizing false detections if the target is dim.
Several researchers expanded the processing degrees of freedom from just spatial processing to spatial and temporal processing12.–3 and spatial and hyperspectral processing.22.214.171.124.126.96.36.199.188.8.131.52.17.18.19.–20 The goal here is to minimize the background clutter and maximize the detectability of any targets in the imagery. All of these papers exploited the classical theory of additive signal detection where the two possible hypotheses are signal(s)-plus-noise and noise alone. Schaum and Daniel recently complained about the continued use of the additive model in electro-optical image analysis because of its “phenomenological inaccuracy.”18 They advocated the use of the more appropriate replacement target model. Their proposed solution was to apply continuum fusion methodology1819.–20 to multispectral imagery, and they presented a detailed paper on its application, with examples to validate their approach to replacement model detection analysis.18 As pointed out by Goudail in a private communication, other researchers have been developing techniques for the replacement target model for some time under the topic of pattern recognition with nonoverlapping targets and background clutter.21 The overarching approach taken by all of these researchers was to make it an estimation and detection problem rather than trying to tackle the classical approach.20
The paper investigates resolved target detection hypothesis testing using highly correlated two-color imagery to obtain large signal processing gains to reduce clutter and extract the target’s location if it is present. It extends the classical approach development of Stotts and Hoff21 to dual-band target detection. This approach assumes that the target profile is contained in a fixed number of pixels since many applications use detection as the first step to classification and identification of the target,2184.108.40.206.220.127.116.11.–31 namely, MF detection (leakage of background clutter into edge pixels reduces the maximum filter gain but usually not by a large amount because of the potentially large number of pixels a resolved image contains12.–3). The reason for only looking at two bands is that many previous research papers have found that “additive noise” detector performances with real data are lower as we spread the processing gain across many bands, which will be discussed in the next section. This also should be true for replacement model theories. This motivated the author to focus on the dual spectral replacement problem where the two bands are correlated enough to reduce the background clutter noise down to the system noise level, hopefully leaving some residual target signatures intact after algorithmic processing. The resulting approach provided simple expressions for the test statistic and the probabilities of false alarm and detection, unlike the normal quadratic detector that requires very complicated computation of these last two entities, even using either Monte Carlo simulations10,31 or numerical methods.32 Finally, this approach reconfirms that the electrical SNR is related to the Weber contrast33 and the normalized noise variance, as shown by Stott and Hoff.21
Background and Motivation for Two-Band Only Optical Detection Strategy
In the majority of the optical target detection strategies in multiband imagery, the solution involves the likelihood ratio, and the required resolved/unresolved target and noise intensity distributions obey multivariate Gaussian probability density functions (PDFs) of the form
In the general case where , the likelihood ratio is given by10 In the above, is the resulting threshold after the term adjustment. Equation (4) is known as the quadratic detector.
Manolakis et al. noted that the variable is a random variable whose probability density depends on which hypothesis is true.10 If the two conditional probability densities, and , are known, then the probabilities of detection and false alarm are given by31 or numerical techniques.32
Another approach to the above is the Reed–Xiaoli (RX) algorithm that provides a generalized likelihood ratio test (GLRT) approach to finding targets in clutter.3435.36.–37,17 Specifically, it is a generalized hypothesis test formulated by partitioning the received bands into two groups. In one group, targets exhibit substantial coloring in their signatures but either behave like gray bodies or emit negligible radiant energy in the other group. Xu et al. developed the following adaptive decision statistics:3636]. In the above, the multispectral sensor is assumed to create a set of -pixel correlated measurement vectors for the band. The resulting matrix is given by Figures 1(a) and 1(b) show the probability of detection versus generalized SNR for for and , respectively, as a function of the number of bands . Figures 2(a) and 2(b) show the probability of detection versus GSNR for for and , respectively, as a function of pixel observations . In these figures, GSNR is the GSNR defined by the equation 36 It is clear in Figs. 1 and 2 that for a given number of bands , the probability of a false alarm and the CFAR probability of detection both improve as the number of pixel observations increases. The limit is when goes to infinity, which results in the perfect MF curves these two graphs.36 On the other hand, the CFAR probability of detection for a fixed number of pixel observations decreases if more bands are used to provide the same GSNR. This is because the number of unknown parameters in the covariance matrix increases as gets larger.36
Hoff et al.6,7 extended to multiple bands the two-band weighted difference (additive noise) hypothesis test developed by Stotts.2 Figures 3 and 4 show the output SNR of their generalized weighted spectral difference detector using thermal infrared multispectral scanner (TIMS) and spatially modulated, imaging, Fourier transform interferometer spectrometer (SMIFTS) image sets, respectively.6,7 The first figure indicates that more than 20 dB gain was obtained for detection by processing beyond one spectral band. There was a significant gain of 16 dB in processing just two spectral bands. Since the first two images processed are very highly correlated, two-band processing appears to cancels most of the image clutter. This figure shows that processing an additional spectral image will not reduce the clutter variance significantly over that of the dual-band processing. (The curves also indicate that the output SNR will gradually level off if more target-reference bands are added.) The second figure confirms these comments using a different dataset. Xu et al.36 and Hallenborg et al.17 also applied a form of the RX algorithm to TIMS data and found similar performance, that is, most performance occurs in fewer bands with a small increase in SNR with additional bands.
Results like these suggest that highly correlated, dual-band images provide close to the maximum signal processing gain possible. In the author’s opinion, adding target and clutter bands gives marginal increased detector performance given the increased computational and sensor design complexity that is required. As we are interested in large signal processing gains with the least complexity, the remainder of the paper will deal with the two-band optical detection problem.
Dual-Band Resolved Target Detection Theory
Let us assume hypothesis is where we have background clutter plus system noise only in the two images and within the pixel template. The resulting vector is given by
The covariance matrix for hypothesis is given by
The inverse matrix can easily be shown to equal
Similarly, we find for hypothesis that its resulting vector is given by
Let us remove the signal and system noise-mean image vectors from both images. Then the resulting vector for becomes
The resulting vector for hypothesis is given by
Since we assume that for . Here,
In Eq. (38), we adjust to keep nonzero for correlation coefficients close to 1. This last assumption says that the best weighted difference noise reduction essentially is where we become system noise–limited and the residual clutter is negligible. This condition would be expected for the closely spaced bands.39,4,6,7,17
If we further assume that , with the appropriate adjustments of to keep nonzero, then Eq. (37) becomes
The term in Eq. (41) is analogous to the processing for the side-lobe canceller radar, that is, the weighted-difference equation. 40,41 It can be shown that the weight minimizes the difference-image variance in a least-mean-square error sense.41
Equation (40) has the form of the equation
In Ref. 21, the quantity is called the noncentrality parameter. Consequently, the probabilities of false alarm and detection are given by
The multiplier on the system noise variance in Eq. (50) comes from the increased variance produced by the weighted difference of the two images.
Following Ref. 21, we define the difference to be the contrast noise ratio (CNR), or
Once again, we see that CNR depends on the Weber contrast squared, divided by the normalized variance, as found in the single channel case.21 The ratio is the color ratio between the two images. The term in Eq. (53) always is positive no matter what the value of the color ratio is.
Theory Validations from Computer Simulation Results
Let us now determine if our false alarm and detection probabilities agree with computer simulation results. We begin by validating the equation for the probability of a false alarm. Specifically, we begin by creating two sets of correlated Gaussian noise images with image correlation and image variances equal to and , respectively. We then add separate, independent system noise with a zero mean and to each image. For these numbers, the weighted difference variance is equal to , which is about a factor of 7 less than . For this simulation, we set the signal levels for the target in images 1 and 2 as 6 and 1, respectively, for all values of index . Similarly, we set the background mean levels in images 1 and 2 as 2 and 1, respectively, for all values of index . This means the pixel contrasts in images 1 and image 1 are 2 and 1, respectively. The next step was to process the two image sets using the formula in Eq. (41) to create an estimated PDF for four MF sizes: , 49, 81, and 121. Figure 5 is one realization of the PDF from the computer simulation. We next calculated its cumulative probability distribution against certain detection thresholds, then subtracted this result from unity so we could compare these results to our equation for the probability of a false alarm. Referring to Fig. 5, the value of appears to be large enough that the PDF approximates a Gaussian PDF by the central limit theorem, which appears to be also true for the other values of employed. As a result, we will use the Gaussian approximation of the noncentral chi-squared distribution in the calculations to come. From previous work,21 we know that the probability of a false alarm for our problem may be approximated asFigure 6 is a comparison of the computer simulation results and the probability of a false alarm using Eq. (54) as a function of the threshold for , 49, 81, and 121 with image correlation . This figure shows good agreement between theory and simulation, with the approximation getting better for low probabilities of a false alarm as increases.
Similarly, we find that the probability of detection can be approximated asFigure 7 compares computer simulation results with the probability of detection using Eq. (59) as a function of the threshold for , 49, 81, and 121. This figure again shows good agreement between theory and simulation. The probability of detection depicts the same kind of cross-over performance shown in the single-channel case reported by Stotts and Hoff.21 As with the single-channel case, the computer simulation results verify the fact that this theory is valid when the weighted difference of the two image contrasts is negative.
Recall in the previous section that our test statistic development required and for . As noted earlier, the former assumption is not a constraint because all good-quality images do not have any system noise speckle evident. However, the second assumption is not as clear. To assess the effect of this assumption, a set of similar computer simulations as described above were performed, but the value of was kept fixed and the image correlation coefficients were varied. Figures 8Fig. 9–10 shows a comparison of computer simulation results and the probability of a false alarm using Eq. (54) as a function of the threshold for , 0.995, 0.9853, 0.9535, and 0.8771 for , 49, and 121, respectively. Table 1 shows a comparison between the weighted-difference variance and the system noise variance for these values of image correlation coefficients. Again, the Gaussian approximation agrees with the data better as increases. It is apparent from this figure that we have good-to-reasonable agreement between theory and simulation for image correlation coefficients of , 0.995, and 0.9853. Referring to Table 1, this means that the assumption appears good for weighted-difference variances on the order of the differenced system noise variance level. The comparison for appears to be in good agreement for false alarm probabilities less than but degrades as the false alarm probability goes to and below and is lower. Here, the weighted variance is over five (5) times the differenced system noise variance. For , we find good agreement above the 50% level, but the comparison becomes poor for low false alarm probabilities and smaller values of . This is not too surprising since the weighted variance is almost 14 times the differenced system noise variance. In both of these latter cases, our theory acts as a lower bound for the false alarm probability. Let us now look at the detection probability.
Comparison of weighted-difference and differenced system noise variances for various image correlation coefficients.
|Image correlation coefficient||Weighted-difference variance||Differenced system noise variance|
Figure 11 gives a comparison of the computer simulation results and the probability of detection using Eq. (59) as a function of the threshold for , 0.995, 0.9853, 0.9535, and 0.8771 for . Similar plots are found for and 49. In all cases, the comparison is good for all values of image correlation. This is not too surprising since we are always interested only in detection probabilities above a few percent levels where the noise floor under hypothesis 1 comprises the Gaussian system noise.
Our conclusion from the above is that this hypothesis test is good for those dual-band spectral image correlations where the resulting weighted difference variance is on the order of, or lower than, the differenced system noise variance. The correlation between images is still high but is not necessarily required to be above 0.9. This suggests that the test statistic is more robust than the approximation suggests, but it should not be expected to detect targets well when the correlation coefficient is low.
Application of Theory to Real Data
In this section, we will apply our theory to the TIMS dataset used by other LRT researchers, recognizing that we will be working with data containing coarsely resolved targets and no system noise. Our intent is to illustrate the theory’s performance under nonoptimal conditions.
The six-band thermal infrared multispectral scanner (TIMS) data have been used by many researchers to validate their additive-noise target detection algorithms over the years.36,17 TIMS is an airborne sensor that covers six thermal infrared spectral bands with center wavelengths of 8.35, 8.74, 9.12, 9.83, 10.69, and . Because of its design, the TIMS sensor does not have system noise. The TIMS dataset that will be used here is from a 1985 night experiment sensing terrain on the outskirts of Adelaide, Australia. These recorded data were images of rural terrain covering several main roads, narrow secondary roads, and some structures. Pixel resolution was a nominal 8 m for this data run. Hallenborg et al. reported that there was a high band-to-band correlation among the various images in this dataset, which they expected for graybody radiation from natural terrain.17
Figures 12(a) and 12(b) show sample images from the TIMS channel 1 () and channel 2 () datasets, respectively. Qualitatively, both images look the same as expected. Figures 13(a) and 13(b) show the PDF histograms for the channel 1 and 2 images, respectively. Clearly, Figs. 12(a) and 12(b) show that sample images from the histograms look Gaussian-like, but they also look slightly different, and their tails are more populated than expected in a Gaussian distribution. Fortunately, the images are highly correlated. Figure 14 shows a scatterplot of these two images, illustrating good correlation between the two datasets. The correlation coefficient between these two sets of data is 0.9961. Similar PDFs, scatter plots, and correlations can be derived from analysis of images from channels 3 and 4 and channels 5 and 6. Following Xu et al.,36 the images were high-pass filtered to remove the low-frequency spatial components using a 9 × 9 element blocking filter located at the origin in the Fourier plane of both images. Locations of the known targets set analyzed in this paper and in the aforementioned papers are shown in Fig. 15.17
As noted by Xu et al.36 and Hallenborg et al.,17 there is a large number of high-intensity points besides the chosen target set. These unresolved points can be traced to unresolved buildings and roads at the test site, which are clearly seen in Fig. 15. This figure depicts all pixel intensities greater than three standard deviations of the difference image of channels 1 and 2 (the total number of pixels is 214). These residual structures essentially create a fixed pattern in all the TIMS imagery that create false detections when processed with anyone’s LRT; that is, they resemble many of the selected targets identified in Fig. 15.
Let us now look at the CFAR performance of our detector against three sets of TIMs image pairs, channels 1 and 2, channels 3 and 4, and channels 5 and 6. In the previously cited works, Xu et al.36 and Hallenborg et al.17 used a spatial processing vector created out of an spatial processing window () chosen for “reasonable detection loss” and “adaptability.”36 The center of the window contains a target shape distribution extracted from the image pixel area centered at (51,134), the location of rural house A. The additional pixels in this profile contain intensities generated by terrain adjacent to the house. The additional pixels outside the shape profile, but within the window, were set to zero. In this analysis, we will only use the exact number of pixels that comprise a selected target; specifically, we will use the three pixel contrasts containing the rural house A, which are located at (51, 133), (52,133), and (51,134), respectively, in all the images. One can call the target quasiresolved, which is not the theory’s basic assumption. That said, the results below suggest that the theory may be useful in that situation as well. In addition, in all the original spectral images, rural house A essentially has intensity values close to those of the clutter levels and does not stand out, that is, it is a low-contrast target. The parameters needed in the test statistic are computed using the entire image; the final test statistic output parameters were derived from a smaller portion of the image away from the three-sigma points, namely, in an area defined by points to to to .
Figure 17 shows all the detected points from processing channel 1 and 2 imagery using Eq. (41) and a CFAR level of . The CFAR threshold was derived from Eq. (47). Of the eight possible targets shown in Fig. 15, the statistical test was only able to detect four of them, which included rural house A, our selected target. The rest of the points in this image are false detections. Comparing this figure to Fig. 16, the test was able to eliminate a large number of the possible false detection points, but not to the level the previous researchers did. They detected seven potential targets, of which five were “true detections of similar structures when compared to ordinary satellite imagery.”17 That is a 71% success rate. Figure 17 shows many more, many of them clumped together. However, given the large difference between the sizes of the processing window, this result is not too bad.
Figure 18 depicts all the detected points from processing channel 3 and 5 imagery at a CFAR level of . Of the eight possible targets, the statistical test was only able to detect three of them, again including rural house A. However, there is a large number of false target detections. Obviously, channels 3 and 4 were not a good choice for discriminating the real target from the residual building and road clutter.
Figure 19 shows all the detected points from processing channel 5 and 6 images at a CFAR level of . Of the eight possible targets, the statistical test detected four, which again included rural house A. Comparing this figure to Fig. 16, the test was able to eliminate most of the possible false detections, showing results more on the line that Xu et al.36 and Hallenborg et al.17 for channel 1 and 2 processing with their algorithms. This suggests that with the right selection of targets and two associated spectral bands, the test could provide good target detectability and false alarm rejection.
Table 2 compares the measured weighted-difference and test statistic variances derived from the test statistic processing of the three TIMS channel sets. Clearly, the correlation coefficient is very high between the channel sets, as noted earlier. The weighted-difference standard deviations agree very well, providing clutter reduction similar to that in side-lobe canceler applications. Unfortunately, the test statistic standard deviations are reasonably close but not in agreement as in the theoretical calculation. The author believes this is because the standard deviation approximation for the noncentral chi-squared PDF usually requires a large to achieve a Gaussian approximation under the central limit theorem. In addition, the presence of the fixed residual pattern and lack of system noise probably contribute to the differences as well. Table 3 shows the improvement by the test statistic processing relative to the original image, which is above 18 dB in all cases. This table suggests a significant improvement in target detectability from the proposed test statistic. Although the data did not meet all the theory’s assumptions, the demonstrated performance in the above figures and tables is encouraging and offers a potentially important tool for processing dual-channel, resolved target imagery with reasonable complexity and effectiveness. More validation of this test statistic is certainly warranted if appropriate datasets can be found.
Comparison of weighted-difference and test statistic variances for the three processed thermal infrared multispectral scanner (TIMS) channel sets.
|TIMS images used||Image correlation coefficient||Weight difference standard deviation calculation||Weight difference standard deviation measurement||Test statistic standard deviation calculation||Test statistic standard deviation measurement|
|Channels 1 and 2||0.9958||429.506||429.51|
|Channels 3 and 4||0.9958||429.51||429.51|
|Channels 5 and 6||0.9874||671.33||671.33|
Comparison of original image and weighted-difference test statistics contrast-to-noise ratios (CNRs) and the effective CNR improvement obtained.
|TIMS images used||Pixel (133, 51) original contrast-squared||Original image clutter variance||Original image CNR (dB)||Test statistic pixel (133, 51) measurement||Weighted-difference variance measurement||Test statistical CNR measurement (dB)||CNR improvement (dB)|
|Channels 1 and 2||16.56||21.51|
|Channels 3 and 4||17.94||18.66|
|Channels 5 and 6||15.37||21.58|
This paper developed a log-likelihood ratio test statistic for resolved target detection in dual-band imagery because previous work indicates that most of the processing gains come from processing just two bands. Simple, closed-form equations for its closed-form probabilities of false alarm and detection are provided. Computer simulation results validated the theory. A CFAR version of the theory is applied to real, available multiband data with quasiresolved target sets and fixed bandwidth noise. The results show very reasonable performance in target detectability using three sets of correlated dual-band images. Finally, the paper showed that the resolved target detection problem depends on the weighted difference between the dual-band target contrasts. The theoretical development reaffirms that the SNR/CNR is approximately that weighted difference squared, divided by the normalized total image noise variance.
The author would like to thank Dr. Lawrence E. (“Skip”) Hoff and Mr. David L. Buck for the many helpful discussions and insights on the real data analysis portion of this paper and for providing the TIMS datasets.
Larry B. Stotts is a resident consultant at Science and Technology Associates. He holds a BA degree in applied physics and information sciences and a PhD in electrical engineering (communications systems), both from the University of California at San Diego. He is the author of more than 100 journal articles, conference papers, and technical reports, and a coauthor of two books and two book chapters. His research interests include RF and laser communications and networking, optical propagation in random and particulate media, image processing, and E/O system design. He is a fellow of SPIE and IEEE and a senior member of the Optical Society of America.