Video semantics discovery from video captions and comments

Rongteng Wu; Jizhou Sun; Jinyan Chen; Huabei Wu

doi:10.1117/12.755871

29 November 2007 Video semantics discovery from video captions and comments

Rongteng Wu, Jizhou Sun, Jinyan Chen, Huabei Wu

Proceedings Volume 6833, Electronic Imaging and Multimedia Technology V; 68332F (2007) https://doi.org/10.1117/12.755871
Event: Photonics Asia 2007, 2007, Beijing, China

Abstract

To improve the retrieval accuracy of content-based video retrieval systems, researchers face a hard challenge that is reducing the 'semantic gap' between the extracted features of the systems and the richness of human semantics. This paper presents a novel video retrieval system to bridge the semantic gap. Firstly, the video captions are segmented from the video and then are transformed into text format. To extract the semantic information from the video streaming we apply a text mining process, which adopts a cluster algorithm as a kernel, on the text format captions. On the other hand, in this system, users are requested to comment on the video which they download from the system when they have watched the video. Then we associate the users' comments with the video on the system. The same text mining process is used to deal with the comment texts. We combine the captions of the video with the comments on the video to extract the semantic information of the video more accurately. Finally, taking advantage of the comments and the captions of the video, we performed experiments on a set of videos and obtained promising results.

Citation Download Citation

Rongteng Wu, Jizhou Sun, Jinyan Chen, and Huabei Wu "Video semantics discovery from video captions and comments", Proc. SPIE 6833, Electronic Imaging and Multimedia Technology V, 68332F (29 November 2007); https://doi.org/10.1117/12.755871

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available