Dynamic saliency detection via CNN and spatial-temporal fusion

Qi Zhang; Dong Xu

doi:10.1117/12.2503058

9 August 2018 Dynamic saliency detection via CNN and spatial-temporal fusion

Qi Zhang, Dong Xu

Proceedings Volume 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018); 1080619 (2018) https://doi.org/10.1117/12.2503058
Event: Tenth International Conference on Digital Image Processing (ICDIP 2018), 2018, Shanghai, China

Abstract

Visual saliency prediction has obtained a significant popularity these years but the majority research is for static saliency prediction. An approach to detect dynamic saliency of videos is proposed in this paper, which exploits a spatial-temporal fusion way. Spatial saliency is detected by a trained convolutional neutral network, and we use a larger convolutional kernel for some layers in our network because saliency is influenced by global contrast according to visual psychology. While temporal saliency is extracted by optical flow and we combine it with K-means cluster, which brings a more accurate result. In addition, the two are fused in an optimal weighted way. Our experiments on DIEM datasets outperforms compared to four other dynamic saliency models on two metrics.

Citation Download Citation

Qi Zhang and Dong Xu "Dynamic saliency detection via CNN and spatial-temporal fusion", Proc. SPIE 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018), 1080619 (9 August 2018); https://doi.org/10.1117/12.2503058

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available