Video saliency detection based on low-level saliency fusion and saliency-aware geodesic

Weisheng Li; Siqin Feng; Hua-Ping Guan; Ziwei Zhan; Cheng Gong

doi:10.1117/1.JEI.28.1.013009

21 January 2019 Video saliency detection based on low-level saliency fusion and saliency-aware geodesic

Weisheng Li, Siqin Feng, Hua-Ping Guan, Ziwei Zhan, Cheng Gong

Author Affiliations +

Journal of Electronic Imaging, Vol. 28, Issue 1, 013009 (January 2019). https://doi.org/10.1117/1.JEI.28.1.013009

Abstract

We present a spatiotemporal saliency detection method for videos. In contrast to previous methods that focus on exploiting the different underlying saliency cues or ignore motion information, the proposed method aims to use both appearance information based on spatial edges and spatial color saliency and motion information based on temporal motion boundaries as indicators of foreground object locations. Spatial color saliency is obtained from the fusion of three color features: color edge connectivity, color rarity, and color compactness. Subsequently, we further smooth the color saliency to eliminate background noises and to further boost the detection accuracy. Then, we propose a strategy-based low-level saliency fusion that guarantees to complementarily employ the smoothed color saliency, spatial edges, and temporal motion boundaries clues toward producing high-accuracy low-level saliency. Subsequently, we generate framewise spatiotemporal saliency maps using a geodesic distance from the low-level saliency. Subsequently, high-quality results are obtained through the geodesic distance to the background area in the subsequent frames. Extensive quantitative and qualitative experiments on three public video datasets demonstrate the superiority of the proposed method over the state-of-the-art algorithms.

Citation Download Citation

Weisheng Li, Siqin Feng, Hua-Ping Guan, Ziwei Zhan, and Cheng Gong "Video saliency detection based on low-level saliency fusion and saliency-aware geodesic," Journal of Electronic Imaging 28(1), 013009 (21 January 2019). https://doi.org/10.1117/1.JEI.28.1.013009

Received: 20 July 2018; Accepted: 19 December 2018; Published: 21 January 2019

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available