5 May 2006 Real-time video mosaicking robust to dynamic scenes
Author Affiliations +
This paper presents a system for creating a mosaic image from a sequence of images with moving objects present in the scene. This system first uses SIFT-based image registration on the entire image to obtain the initial global projection matrix. After image segmentation, the global motion model is applied to each region for evaluation. The transformation matrix is refined for best projection in each region, and a more precise global transformation matrix is calculated based upon local projections on majority of coherent regions. As a consequence this method is robust to disturbances to the projection model induced by moving objects and motion parallax. In the image blending stage, pixels in coherent regions are weighted by their distances from the overlapping edges to achieve a seamless panorama, while heterogeneous regions are cut and pasted to avoid ghosting or blurring. The most recent information regarding location, shape, and size of the moving foreground objects is therefore reflected in the panorama. Constructed mosaics are presented to demonstrate the performance and robustness of the proposed algorithm.
© (2006) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Nan Jiang, Nan Jiang, Glen Abousleman, Glen Abousleman, Jennie Si, Jennie Si, "Real-time video mosaicking robust to dynamic scenes", Proc. SPIE 6209, Airborne Intelligence, Surveillance, Reconnaissance (ISR) Systems and Applications III, 620907 (5 May 2006); doi: 10.1117/12.665880; https://doi.org/10.1117/12.665880


Semiautomatic video layering using 2D mesh tracking
Proceedings of SPIE (January 08 1998)
Region-based H.263+ coding for real-time video communication
Proceedings of SPIE (January 03 2002)
Fast and robust image mosaicking for monocular video
Proceedings of SPIE (May 24 2005)
Three-dimensional semantic object tracking in video sequences
Proceedings of SPIE (December 26 2000)
Generating panorama photos
Proceedings of SPIE (November 25 2003)

Back to Top