Robust visual object tracking with interleaved segmentation

Peter Abel; Hilke Kieritz; Stefan Becker; Michael Arens

doi:10.1117/12.2275259

Translator Disclaimer

5 October 2017 Robust visual object tracking with interleaved segmentation

Peter Abel, Hilke Kieritz, Stefan Becker, Michael Arens

Author Affiliations +

Proceedings Volume 10441, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies; 104410B (2017) https://doi.org/10.1117/12.2275259
Event: SPIE Security + Defence, 2017, Warsaw, Poland

Abstract

In this paper we present a new approach for tracking non-rigid, deformable objects by means of merging an on-line boosting-based tracker and a fast foreground background segmentation. We extend an on-line boosting- based tracker, which uses axes-aligned bounding boxes with fixed aspect-ratio as tracking states. By constructing a confidence map from the on-line boosting-based tracker and unifying this map with a confidence map, which is obtained from a foreground background segmentation algorithm, we build a superior confidence map. For constructing a rough confidence map of a new frame based on on-line boosting, we employ the responses of the strong classifier as well as the single weak classifier responses that were built before during the updating step. This confidence map provides a rough estimation of the object’s position and dimension. In order to refine this confidence map, we build a fine, pixel-wisely segmented confidence map and merge both maps together. Our segmentation method is color-histogram-based and provides a fine and fast image segmentation. By means of back-projection and the Bayes’ rule, we obtain a confidence value for every pixel. The rough and the fine confidence maps are merged together by building an adaptively weighted sum of both maps. The weights are obtained by utilizing the variances of both confidence maps. Further, we apply morphological operators in the merged confidence map in order to reduce the noise. In the resulting map we estimate the object localization and dimension via continuous adaptive mean shift. Our approach provides a rotated rectangle as tracking states, which enables a more precise description of non-rigid, deformable objects than axes-aligned bounding boxes. We evaluate our tracker on the visual object tracking (VOT) benchmark dataset 2016.

Citation Download Citation

Peter Abel, Hilke Kieritz, Stefan Becker, and Michael Arens "Robust visual object tracking with interleaved segmentation", Proc. SPIE 10441, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies, 104410B (5 October 2017); https://doi.org/10.1117/12.2275259

ACCESS THE FULL ARTICLE