Saliency detection for videos using 3D FFT local spectra

Zhiling Long; Ghassan AlRegib

doi:10.1117/12.2077762

17 March 2015 Saliency detection for videos using 3D FFT local spectra

Zhiling Long, Ghassan AlRegib

Proceedings Volume 9394, Human Vision and Electronic Imaging XX; 93941G (2015) https://doi.org/10.1117/12.2077762
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

Bottom-up spatio-temporal saliency detection identifies perceptually important regions of interest in video sequences. The center-surround model proves to be useful for visual saliency detection. In this work, we explore using 3D FFT local spectra as features for saliency detection within the center-surround framework. We develop a spectral location based decomposition scheme to divide a 3D FFT cube into two components, one related to temporal changes and the other related to spatial changes. Temporal saliency and spatial saliency are detected separately using features derived from each spectral component through a simple center-surround comparison method. The two detection results are then combined to yield a saliency map. We apply the same detection algorithm to different color channels (YIQ) and incorporate the results into the final saliency determination. The proposed technique is tested with the public CRCNS database. Both visual and numerical evaluations verify the promising performance of our technique.

Citation Download Citation

Zhiling Long and Ghassan AlRegib "Saliency detection for videos using 3D FFT local spectra", Proc. SPIE 9394, Human Vision and Electronic Imaging XX, 93941G (17 March 2015); https://doi.org/10.1117/12.2077762

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available