28 March 2005 Real-time implementation of image alignment and fusion
Author Affiliations +
Many modern imaging and surveillance systems contain more than one sensor. For example, most modern airborne imaging pods contain at least visible and infrared sensors. Often these systems have a single display that is only capable of showing data from either camera, and thereby fail to exploit the benefit of having simultaneous multi-spectral data available to the user. It can be advantageous to capture all spectral features within each image and to display a fused result rather than single band imagery. This paper discusses the key processes necessary for an image fusion system and then describes how they were implemented in a real-time, rugged hardware system. The problems of temporal and spatial misalignment of the sensors and the process of electronic image warping must be solved before the image data is fused. The techniques used to align the two inputs to the fusion system are described and a summary is given of our research into automatic alignment techniques. The benefits of different image fusion schemes are discussed and those that were implemented are described. The paper concludes with a summary of the real-time implementation of image alignment and image fusion by Octec and Waterfall Solutions and the problems that have been encountered and overcome.
© (2005) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
David J. Dwyer, Moira I. Smith, Jason L. Dale, Jamie P. Heather, "Real-time implementation of image alignment and fusion", Proc. SPIE 5813, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2005, (28 March 2005); doi: 10.1117/12.603503; https://doi.org/10.1117/12.603503

Image fusion

Image processing


Image sensors

Imaging systems




NV-CMOS HD camera for day/night imaging
Proceedings of SPIE (June 09 2014)
Depth perception by controlling focus
Proceedings of SPIE (April 30 1992)
Real-time implementation of image alignment and fusion
Proceedings of SPIE (December 06 2004)

Back to Top