Translator Disclaimer
12 April 2004 Advanced surveillance systems: combining video and thermal imagery for pedestrian detection
Author Affiliations +
In the current context of increased surveillance and security, more sophisticated surveillance systems are needed. One idea relies on the use of pairs of video (visible spectrum) and thermal infrared (IR) cameras located around premises of interest. To automate the system, a dedicated image processing approach is required, which is described in the paper. The first step in the proposed study is to collect a database of known scenarios both indoor and outdoor with a few pedestrians. These image sequences (video and TIR) are synchronized, geometrically corrected and temperature calibrated. The next step is to develop a segmentation strategy to extract the regions of interest (ROI) corresponding to pedestrians in the images. The retained strategy exploits the motion in the sequences. Next, the ROIs are grouped from image to image separately for both video and TIR sequences before a fusion algorithm proceeds to track and detect humans. This insures a more robust performance. Finally, specific criteria of size and temperature relevant to humans are introduced as well. Results are presented for a few typical situations.
© (2004) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Helene Torresan, Benoit Turgeon, Clemente Ibarra-Castanedo, Patrick Hebert, and Xavier P. Maldague "Advanced surveillance systems: combining video and thermal imagery for pedestrian detection", Proc. SPIE 5405, Thermosense XXVI, (12 April 2004);


Pedestrian tracking using thermal infrared imaging
Proceedings of SPIE (May 18 2006)
Benefits of IR/visible fusion
Proceedings of SPIE (April 09 2007)

Back to Top