Acoustic events semantic detection, classification, and annotation for persistent surveillance applications

Amjad Alkilani; Amir Shirkhodaie

doi:10.1117/12.2050907

20 June 2014 Acoustic events semantic detection, classification, and annotation for persistent surveillance applications

Amjad Alkilani, Amir Shirkhodaie

Author Affiliations +

Proceedings Volume 9091, Signal Processing, Sensor/Information Fusion, and Target Recognition XXIII; 909119 (2014) https://doi.org/10.1117/12.2050907
Event: SPIE Defense + Security, 2014, Baltimore, MD, United States

Abstract

Understanding of group activity based on analysis of spatiotemporally correlated acoustic sound events has received a minimum attention in the literature and hence is not well understood. Identification of group sub-activities such as: Human-Vehicle Interactions (HVI), Human-Object Interactions (HOI), and Human-Human Interactions (HHI) can significantly improve Situational Awareness (SA) in Persistent Surveillance Systems (PSS). In this paper, salient sound events associated with group activities are preliminary identified and applied for training a Gaussian Mixture Model (GMM) whose features are employed as feature vectors for training of algorithms for acoustic sound recognition. In this paper, discrimination of salient sounds associated with the HVI, HHI, and HOI events is achieved via a Correlation Based Template Matching (CMTM) classifier. To interlinked salient events representing an ontology-based hypothesis, a Hidden Markov Model (HMM) is employed to recognize spatiotemporally correlated events. Once such a connection is established, then, the system generates an annotation of each perceived sound event. This paper discusses the technical aspects of this approach and presents the experimental results for several outdoor group activities monitored by an array of acoustic sensors.

Citation Download Citation

Amjad Alkilani and Amir Shirkhodaie "Acoustic events semantic detection, classification, and annotation for persistent surveillance applications", Proc. SPIE 9091, Signal Processing, Sensor/Information Fusion, and Target Recognition XXIII, 909119 (20 June 2014); https://doi.org/10.1117/12.2050907

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available