Multi-feature based visual saliency detection in surveillance video

Yubing Tong; Hubert Konik; Faouzi Alaya Cheikh; Fahad Fazal Elahi Guraya; Alain Tremeau

doi:10.1117/12.863281

13 July 2010 Multi-feature based visual saliency detection in surveillance video

Yubing Tong, Hubert Konik, Faouzi Alaya Cheikh, Fahad Fazal Elahi Guraya, Alain Tremeau

Proceedings Volume 7744, Visual Communications and Image Processing 2010; 774404 (2010) https://doi.org/10.1117/12.863281
Event: Visual Communications and Image Processing 2010, 2010, Huangshan, China

Abstract

The perception of video is different from that of image because of the motion information in video. Motion objects lead to the difference between two neighboring frames which is usually focused on. By far, most papers have contributed to image saliency but seldom to video saliency. Based on scene understanding, a new video saliency detection model with multi-features is proposed in this paper. First, background is extracted based on binary tree searching, then main features in the foreground is analyzed using a multi-scale perception model. The perception model integrates faces as a high level feature, as a supplement to other low-level features such as color, intensity and orientation. Motion saliency map is calculated using the statistic of the motion vector field. Finally, multi-feature conspicuities are merged with different weights. Compared with the gaze map from subjective experiments, the output of the multi-feature based video saliency detection model is close to gaze map.

Citation Download Citation

Yubing Tong, Hubert Konik, Faouzi Alaya Cheikh, Fahad Fazal Elahi Guraya, and Alain Tremeau "Multi-feature based visual saliency detection in surveillance video", Proc. SPIE 7744, Visual Communications and Image Processing 2010, 774404 (13 July 2010); https://doi.org/10.1117/12.863281

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available