28 December 1998 Extraction of moving objects for content-based video coding
Author Affiliations +
This paper considers video object plane (VOP) segmentation for the content-based video coding standard MPEG-4. To provide multimedia applications with new functionalities, such as content-based interactivity and scalability, the new video coding standard MPEG-4 relies on a content-based representation. To take advantage of these functionalities, a prior decomposition of sequences into semantically meaningful, physical objects is required. We formulate this problem as one of separating foreground objects from the background based on motion information. For the object of interest, a two- dimensional binary model is derived and tracked throughout the sequence. The model points consist of edge pixels detected by the Canny operator. To accommodate rotation and changes in shape of the tracked object, the model is updated every frame. These binary models then guide the actual VOP extraction. Due to the excellent edge localization properties of the Canny operator, the resulting VOP contours are very accurate. Both the model initialization and update stage exploit motion information. The main assumption underlying our approach is the existence of a dominant global motion that can be assigned to the background. Areas that do not follow this background motion indicate the presence of independently moving physical objects. Two methods to identify such objects are presented. The first one employs a morphological motion filter with a new filtering criterion that measures the deviation of the locally estimated optical flow from the corresponding global motion. The second method computes a change detection mask by taking the difference between consecutive frames. The first version is more suitable for sequences involving little motion, whereas the second version is stronger at dealing with fast moving objects.
© (1998) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Thomas Meier, Thomas Meier, King N. Ngan, King N. Ngan, } "Extraction of moving objects for content-based video coding", Proc. SPIE 3653, Visual Communications and Image Processing '99, (28 December 1998); doi: 10.1117/12.334624; https://doi.org/10.1117/12.334624


Back to Top