Kernel-based multiple-cue algorithm for object segmentation

Jian Wang; Ze-Nian Li

doi:10.1117/12.382979

19 April 2000 Kernel-based multiple-cue algorithm for object segmentation

Jian Wang, Ze-Nian Li

Proceedings Volume 3974, Image and Video Communications and Processing 2000; (2000) https://doi.org/10.1117/12.382979
Event: Electronic Imaging, 2000, San Jose, CA, United States

Abstract

This paper proposes a novel algorithm to solve the problem of segmenting foreground-moving objects from the background scene. The major cue used for object segmentation is the motion information, which is initially extracted from MPEG motion vectors. Since the MPEG motion vectors are generated for simple video compression without any consideration of visual objects, they may not correspond to the true motion of the macroblocks. We propose a Kernel-based Multiple Cue (KMC) algorithm to deal with the above inconsistency of MPEG motion vectors and use multiple cues to segment moving objects. KMC detects and calibrates camera movements; and then finds the kernels of moving objects. The segmentation starts from these kernels, which are textured regions with credible motion vectors. Beside motion information, it also makes use of color and texture to help achieving a better segmentation. Moreover, KMC can keep track of the segmented objects over multiple frames, which is useful for object-based coding. Experimental results show that KMC combines temporal and spatial information in a graceful way, which enables it to segment and track the moving objects under different camera motions. Future work includes object segmentation in compressed domain, motion estimation from raw video, etc.

Citation Download Citation

Jian Wang and Ze-Nian Li "Kernel-based multiple-cue algorithm for object segmentation", Proc. SPIE 3974, Image and Video Communications and Processing 2000, (19 April 2000); https://doi.org/10.1117/12.382979

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available