Linear pyroelectric array sensors have enabled useful classifications of objects such as humans and animals to be performed with relatively low-cost hardware in border and perimeter security applications. Ongoing research has sought to improve the performance of these sensors through signal processing algorithms. In the research presented here, we introduce the use of hidden Markov tree (HMT) models for object recognition in images generated by linear pyroelectric sensors. HMTs are trained to statistically model the wavelet features of individual objects through an expectation–maximization learning process. Human versus animal classification for a test object is made by evaluating its wavelet features against the trained HMTs using the maximum-likelihood criterion. The classification performance of this approach is compared to two other techniques; a texture, shape, and spectral component features (TSSF) based classifier and a speeded-up robust feature (SURF) classifier. The evaluation indicates that among the three techniques, the wavelet-based HMT model works well, is robust, and has improved classification performance compared to a SURF-based algorithm in equivalent computation time. When compared to the TSSF-based classifier, the HMT model has a slightly degraded performance but almost an order of magnitude improvement in computation time enabling real-time implementation.
Detecting suspicious behaviors is important for surveillance and monitoring systems. In this paper, we investigate suspicious activity detection in thermal infrared imagery, where human motion can be easily detected from the background regardless of the lighting conditions and colors of the human clothing and surfaces. We use locally adaptive regression kernels (LARK) as patch descriptors, which capture the underlying local structure of the data exceedingly well, even in the presence of significant distortions. Patch descriptors are generated for each query patch and for each database patch. A statistical approach is used to match the query activity with the database to make the decision of suspicious activity. Human activity videos in different condition such as, walking, running, carrying a gun, crawling, and carrying backpack in different terrains were acquired using thermal infrared camera. These videos are used for training and performance evaluation of the algorithm. Experimental results show that the proposed approach achieves good performance in suspicious activity recognition.
In this paper, we propose a real-time human versus animal classification technique using a pyro-electric sensor array and Hidden Markov Model. The technique starts with the variational energy functional level set segmentation technique to separate the object from background. After segmentation, we convert the segmented object to a signal by considering column-wise pixel values and then finding the wavelet coefficients of the signal. HMMs are trained to statistically model the wavelet features of individuals through an expectation-maximization learning process. Human versus animal classifications are made by evaluating a set of new wavelet feature data against the trained HMMs using the maximum-likelihood criterion. Human and animal data acquired-using a pyro-electric sensor in different terrains are used for performance evaluation of the algorithms. Failures of the computationally effective SURF feature based approach that we develop in our previous research are because of distorted images produced when the object runs very fast or if the temperature difference between target and background is not sufficient to accurately profile the object. We show that wavelet based HMMs work well for handling some of the distorted profiles in the data set. Further, HMM achieves improved classification rate over the SURF algorithm with almost the same computational time.
Classification of human and animal targets imaged by a linear pyroelectic array senor presents some unique challenges especially in target segmentation and feature extraction. In this paper, we apply two approaches to address this problem. Both techniques start with the variational energy functional level set segmentation technique to separate the object from background. After segmentation, in the first technique, we extract features such as texture, invariant moments, edge, shape information, and spectral contents of the segmented object. These features are fed to classifiers including Naïve Bayesian (NB), and Support Vector Machine (SVM) for human against animal classification. In the second technique, the speeded up robust feature (SURF) extraction algorithm is applied to the segmented objects. A code book technique is used to classify objects based on SURF features. Human and animal data acquired-using the pyroelectric sensor in different terrains, are used for performance evaluation of the algorithms. The evaluation indicates that the features extracted in the first technique in conjunction with the NB classifier provide the highest classification rates. While the SURF feature plus code book approach provides a slightly lower classification rate, it provides better computational efficiency lending itself to real time implementation.