Human sound detection on experience movies

Shogo Shimura; Yasushi Hirano; Shoji Kajita; Kenji Mase

doi:10.1117/12.641586

10 February 2006 Human sound detection on experience movies

Shogo Shimura, Yasushi Hirano, Shoji Kajita, Kenji Mase

Proceedings Volume 6074, Multimedia on Mobile Devices II; 60740T (2006) https://doi.org/10.1117/12.641586
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

In this paper, we describe an indexing method for video lifelog using sounds generated by human actions. The miniaturization of information-processing devices has enabled us to constantly record experience movies recently. However, these movies include many useless parts for a user. It is important to automatically extract only useful experiences from whole records. If a tool to easily add indices to important experiences is provided, users can mark these ones. Even though it is easy to add indices with some device, considering users' loads, it is undesirable for users to wear devices other than a microphone and a video camera that are needed to record experiences. Therefore, we propose a method that users can add indices using sounds which can be generated by using a part of users' body. We especially analyzed typical sounds like hand clapping and finger clicking sounds that users can generate themselves. A detection method of two index-sounds was developed. We performed an experiment to confirm the recall ratio and relevance ratio of two index-sounds. A wearable system was worn by a subject and experiences were recorded for ten days (about 100 hours). The proposed detection method was applied to recorded data, and two index-sounds were detected with the recall ratio 86.0% and the relevance ratio 83.6%.

Citation Download Citation

Shogo Shimura, Yasushi Hirano, Shoji Kajita, and Kenji Mase "Human sound detection on experience movies", Proc. SPIE 6074, Multimedia on Mobile Devices II, 60740T (10 February 2006); https://doi.org/10.1117/12.641586

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Cameras

Information visualization

Visualization

Detection and tracking algorithms

Control systems

Optical resolution

Show All Keywords

Keywords/Phrases

Search In:

Publication Years