Introduction and Motivation
A crucial problem in spaceborne and IR surveillance systems today is the detection and recognition of weak moving targets at low signal-to-noise/clutter ratios. Algorithms are currently available to reduce background clutter and random noise and to enhance target detectability. Early work in infrared search and track systems was adequate for early applications in which the targets were bright compared to the background clutter.1, 2 For situations in which the noise in the entire scene does not follow a particular model, partitioning the images into areas with different noise characteristics was proposed.3 Tarun, Zeidler, and Ku,4 and Lin, Nie, and Unbehauen5 studied the performance of a spatial filter based on two-dimensional least mean square (TDLMS) adaptive filters and local-mean removal filters for the detection of small objects in image data.
The algorithms mentioned are isotropic high-pass filters commonly used in the field of dim target detection, but it is difficult for them to smooth edges caused by image texture. We are eager to discover a useful way to overcome this major disadvantage. To solve this problem, the challenge is to design methods that can selectively smooth a noisy image without losing significant features. A partial differential equation (PDE) is the best choice. Since it was introduced by Perona and Malik,6 much research has been devoted to its theoretical and practical understanding. Black 7 studied the relation between PDE and robust statistics. You and Kaveh,8 and Lysaker, Lundervold, and Tai9 used fourth-order PDE to optimize the trade-off between noise removal and edge preservation, and to overcome the staircase effect that occurs with the TV-norm filter. Scharr and Spies10 combined 3-D anisotropic diffusion and motion estimation for denoising and improvement of motion estimation.
Our primary motivation was to propose a novel algorithm to further smooth the edge texture and promote the ability of detecting weaker targets. In Sec. 2 we introduces the Perona and Malik PDE model. In Sec. 3 we develop a novel background clutter and random sensor noise suppression method based on double threshold PDE (DTPDE). In Sec. 4 we present the application of a new algorithm and analysis the comparison of the new algorithm and TDLMS target detection algorithm. We come to a conclusion in Sec. 5.
Perona and Malik Anisotropic Diffusion Model
Perona and Malik proposed a nonlinear diffusion method for avoiding the blurring and localization problems of linear diffusion filtering. They applied an inhomogeneous process that reduces the diffusivity at those locations, which have a larger likelihood to be edges. This likelihood is measured by .is the diffused image. determines the diffusion time. is the image gradient, and is a non-negative diffusion coefficient threshold function formulated as:
Equation 1 can be discretized as follows, using a four-nearest-neighbors discretization of the Laplacian operator:is the discretely sampled image, denotes the pixel position, and is the discrete time step iterations. The constant is a scalar that determines the diffusion rate, and represents the spatial neighborhood of pixel . Perona and Malik linearly approximated the gradient in a particular direction as
Proposed Target Detection Algorithm—Double-Threshold Partial Differential Algorithm
Detection of targets against complex cluttered background is generally impossible using only a single frame. The image sequence contains randomly drifting cluttered background and may also be contaminated by random sensor noise. Since the field of view is relatively fixed with respect to the background, the complicated background clutter can be removed by a prewhitening method. The usual way is local mean removal, two-dimensional least mean square (TDLMS) adaptive filters, or differencing operation, etc. But they are useless for the texture change of background, since they are isotropic filters. If the target velocity is small, the targets will be eliminated by the differencing way. And those methods are all sensitive to the image shifting. Here, we propose a novel algorithm based on DTPDE to overcome those shortcomings. The proposed algorithm works quite well for detecting moving targets against complex cluttered background and random noise. It is composed of four parts: the DTPDE background estimation algorithm, clutter eliminating, random noise suppression, and target trajectories estimation.
We mainly present the first part—the DTPDE background estimation algorithm. In contrast with isotropic filters like TDLMS, the PDE process is twofold: the edges remain stable while noise is smoothed locally. The main mission of target detection in the complex cluttered background is to suppress the complicated clutter. The proposed algorithm DTPDE improves on the PDE algorithm to satisfy the practical application of executing the task of recovering a good estimate of the true image from a degraded observation. It can be formulated as follows:and represent the eight-nearest and four-nearest spatial discretization neighborhood of pixel , respectively. is a diffusive coefficient threshold function as described in Eq. 4, is the second diffusive coefficient threshold function formula as and are formulated as
Figure 1 depicts the performance of the two “edge-stopping” threshold functions and . As we will see, the choice of and can greatly affect the extent to which discontinuities are preserved. Understanding this is one of the main goals of this work.
It is obvious that the texture edges remain sharp and stable, while smoothing takes place only inside the regions and acts even more effectively. This can be mathematically explained by analysis of the threshold function and . In , for large values of , we have small participation of the gradient and thus a large diffusion effect; inversely, for small values of , we have much participation of the gradient and small diffusion. And if we have another look at the function , it is just the contrary. The DTPDE method uses two thresholds to detect strong and weak edges separately. In the smooth area with small gradient, we use isotropic diffusion to eliminate noises and dim targets. In the edge area with great gradient within the two thresholds, we use double threshold anisotropic diffusion to eliminate noises and dim targets, but keep the edges sharp and stable. Outside of the two thresholds, we ignore it.
The constants and were decided by using the noise estimator described by Canny; a histogram of absolute values of the image gradient was computed. and were set equal to and value of their integral at every iteration, respectively, and were decided by the image and real application requirements.
After using the DTPDE algorithm to estimate the cluttered background, we use subtraction to eliminate the cluttered background from the initial image . It can be formulated as
Then, we can use a multiframe accumulation method, or autocorrelation or time-predicting algorithm, or velocity filtering theory to suppress the random noise. Considering the trade-off between performance and computer complexity, we chose a time-predicting algorithm (TPA). It can be expressed in the following formula:
After the cluttered background and random noise suppression, we can use dynamic programming, pipeline filtering, the Hough transform, or track matching algorithm to estimate the target trajectories.
Experiments and Results
After cluttered background and random noise suppression, the initial image sequence is transformed into , which has whitening structures and characteristics. To evaluate the background clutter and random noise suppression ability, we define the local integrated signal to clutter ratio and global integrated signal to clutter ratio as follows,is the intensity value of the target, and is the average intensity value of the pixels in the neighbor area around the target. is the relative value of the target. is the standard variance of the neighbor area around the target, and is the image’s standard variance.
ISCRl and ISCRg of different algorithms.
We propose a novel target detection algorithm based on DTPDE. It is heuristically demonstrated that the proposed algorithm is very successful for the task of detection and tracking of pixel-sized target trajectories. We illustrate the performance comparisons of the proposed method and TDLMS algorithm applied to IR images in real-world conditions. The experiment results prove that our improved algorithms promote the ability to detect weaker targets with seriously cluttered image sequences with very low signal-to-noise ratio.
This work was supported by the National Natural Science Foundation of China (number 60135020).