18 October 1999 Compressed-domain video segmentation using wavelet transformation
Author Affiliations +
Video segmentation is an important first step towards automatic video indexing, retrieval, editing, and etc. However, the 'large' property of video makes it hard to handle in real time. To fulfill the goal of real-time processing, several factors need to be considered. First of all, indexing video directly in the compressed-domain offers the advantages of fast processing upon efficient storage. Secondly, extracting simple features with fast algorithms is no doubt helpful in speeding up the process. The questions are what kind of simple feature can characterize the changing statistics and what kind of algorithm can provide such feature with fast executability. In this paper, we propose a new automatic video segmentation scheme that utilizes wavelet transformation based on the following consideration: wavelet is a nice tool for subband decomposition, it encodes both frequency and spatial information; more over, it is easy to program and fast to execute. In the last decade or so, wavelet transform is emerged to image/video signal processing for analyzing functions at different levels of details. In particular, wavelet, as a tool, has been widely used in the area of image compression. In image compression, it is possible to recover a fairly accurate representation of the image by saving the few largest wavelet coefficients (and throwing away part or all of the smaller coefficients). By using this property, we extract a discrimination signature of each image from a few large coefficients for each color channel. The system works on the compressed video that does not require full decoding of the video and performs a wavelet transformation on the extracted video data. The signature (as feature) is extracted from the wavelet coefficients to characterize the changing statistics of shot transitions. Cuts, fades, and dissolve are detected based on the analysis of the changing statistics curve.
© (1999) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Hong Heather Yu, Hong Heather Yu, } "Compressed-domain video segmentation using wavelet transformation", Proc. SPIE 3808, Applications of Digital Image Processing XXII, (18 October 1999); doi: 10.1117/12.365830; https://doi.org/10.1117/12.365830


Region-of-interest-based ultra-low-bit-rate video coding
Proceedings of SPIE (March 24 2008)
An adaptive wavelet-based deblocking algorithm for MPEG-4 codec
Proceedings of SPIE (September 16 2005)
Adaptive wavelet eye-gaze-based video compression
Proceedings of SPIE (March 18 2003)
Automatic home video abstraction using audio contents
Proceedings of SPIE (August 29 2002)
Spatially reduced image extraction from MPEG 2 video fast...
Proceedings of SPIE (December 22 1997)
Performance analysis of 3D subband coding for low bit rate...
Proceedings of SPIE (September 15 1996)

Back to Top