24 January 2011 High precision object segmentation and tracking for use in super resolution video reconstruction
Author Affiliations +
Super resolution image reconstruction allows for the enhancement of images in a video sequence that is superior to the original pixel resolution of the imager. Difficulty arises when there are foreground objects that move differently than the background. A common example of this is a car in motion in a video. Given the common occurrence of such situations, super resolution reconstruction becomes non-trivial. One method for dealing with this is to segment out foreground objects and quantify their pixel motion differently. First we estimate local pixel motion using a standard block motion algorithm common to MPEG encoding. This is then combined with the image itself into a five dimensional mean-shift kernel density estimation based image segmentation with mixed motion and color image feature information. This results in a tight segmentation of objects in terms of both motion and visible image features. The next step is to combine segments into a single master object. Statistically common motion and proximity are used to merge segments into master objects. To account for inconsistencies that can arise when tracking objects, we compute statistics over the object and fit it with a generalized linear model. Using the Kullback-Leibler divergence, we have a metric for the goodness of the track for an object between frames.
© (2011) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
T. Nathan Mundhenk, T. Nathan Mundhenk, Rashmi Sundareswara, Rashmi Sundareswara, David R. Gerwe, David R. Gerwe, Yang Chen, Yang Chen, "High precision object segmentation and tracking for use in super resolution video reconstruction", Proc. SPIE 7878, Intelligent Robots and Computer Vision XXVIII: Algorithms and Techniques, 78780G (24 January 2011); doi: 10.1117/12.871605; https://doi.org/10.1117/12.871605


Back to Top