19 January 2006 Video frame rate up conversion under inconsistent camera
Author Affiliations +
In this paper, we address the problem of video frame rate up conversion (FRC) in compressed domain. FRC is often recognized as video temporal interpolation. The problem is very challenging when targeted for a video sequence with an inconsistent camera and object motion. A novel compressed domain motion compensation scheme is presented and applied in this paper. The proposed algorithm uses MPEG-2 compressed motion vectors to undergo a cumulative spatiotemporal interpolation over a temporal sliding window of frames. An iterative rejection scheme based on the affine motion model is exploited to detect the global camera motion. Subsequently, the foreground object separation is performed by examining the temporal consistency of the output of iterative rejections. This consistency check process helps to conglomerate the resulting foreground macroblocks and weeds out the unqualified blocks, thus further refines the crude segmentation results. Finally, different strategies for compensating the camera motion and the object motion are applied to interpolate the new frames. Illustrative examples are provided to demonstrate the efficacy of the proposed approach. Experimental results are compared with the popular block based frame interpolation approach.
© (2006) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Jinsong Wang, Jinsong Wang, Nilesh Patel, Nilesh Patel, William Grosky, William Grosky, } "Video frame rate up conversion under inconsistent camera", Proc. SPIE 6077, Visual Communications and Image Processing 2006, 60771Z (19 January 2006); doi: 10.1117/12.643338; https://doi.org/10.1117/12.643338


Tools for compressed-domain video indexing and editing
Proceedings of SPIE (March 12 1996)
Trajectory guided recognition of actions
Proceedings of SPIE (November 07 1999)
Scene decomposition of MPEG-compressed video
Proceedings of SPIE (April 16 1995)

Back to Top