Translator Disclaimer
9 April 2007 Real-time EO/IR sensor fusion on a portable computer and head-mounted display
Author Affiliations +
Multi-sensor platforms are widely used in surveillance video systems for both military and civilian applications. The complimentary nature of different types of sensors (e.g. EO and IR sensors) makes it possible to observe the scene under almost any condition (day/night/fog/smoke). In this paper, we propose an innovative EO/IR sensor registration and fusion algorithm which runs real-time on a portable computing unit with head-mounted display. The EO/IR sensor suite is mounted on a helmet for a dismounted soldier and the fused scene is shown in the goggle display upon the processing on a portable computing unit. The linear homography transformation between images from the two sensors is precomputed for the mid-to-far scene, which reduces the computational cost for the online calibration of the sensors. The system is implemented in a highly optimized C++ code, with MMX/SSE, and performing a real-time registration. The experimental results on real captured video show the system works very well both in speed and in performance.
© (2007) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Zhanfeng Yue and Pankaj Topiwala "Real-time EO/IR sensor fusion on a portable computer and head-mounted display", Proc. SPIE 6571, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2007, 657106 (9 April 2007);

Back to Top