Video genre categorization and representation using audio-visual information

Bogdan E. Ionescu; Christoph Rasche; Constantin Vertan; Patrick Lambert; Klaus Seyerlehner

doi:10.1117/1.JEI.21.2.023017

22 June 2012 Video genre categorization and representation using audio-visual information

Bogdan E. Ionescu, Christoph Rasche, Constantin Vertan, Patrick Lambert, Klaus Seyerlehner

Author Affiliations +

Journal of Electronic Imaging, Vol. 21, Issue 2, 023017 (June 2012). https://doi.org/10.1117/1.JEI.21.2.023017

Abstract

We propose an audio-visual approach to video genre classification using content descriptors that exploit audio, color, temporal, and contour information. Audio information is extracted at block-level, which has the advantage of capturing local temporal information. At the temporal structure level, we consider action content in relation to human perception. Color perception is quantified using statistics of color distribution, elementary hues, color properties, and relationships between colors. Further, we compute statistics of contour geometry and relationships. The main contribution of our work lies in harnessing the descriptive power of the combination of these descriptors in genre classification. Validation was carried out on over 91 h of video footage encompassing 7 common video genres, yielding average precision and recall ratios of 87% to 100% and 77% to 100%, respectively, and an overall average correct classification of up to 97%. Also, experimental comparison as part of the MediaEval 2011 benchmarking campaign demonstrated the efficiency of the proposed audio-visual descriptors over other existing approaches. Finally, we discuss a 3-D video browsing platform that displays movies using feature-based coordinates and thus regroups them according to genre.

Citation Download Citation

Bogdan E. Ionescu, Christoph Rasche, Constantin Vertan, Patrick Lambert, and Klaus Seyerlehner "Video genre categorization and representation using audio-visual information," Journal of Electronic Imaging 21(2), 023017 (22 June 2012). https://doi.org/10.1117/1.JEI.21.2.023017

Published: 22 June 2012

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available