Optimal detection of objects in images and videos using electroencephalography (EEG)

Deepak Khosla; Rajan Bhattacharyya; Penn Tasinga; David J. Huber

doi:10.1117/12.883586

5 May 2011 Optimal detection of objects in images and videos using electroencephalography (EEG)

Deepak Khosla, Rajan Bhattacharyya, Penn Tasinga, David J. Huber

Proceedings Volume 8050, Signal Processing, Sensor Fusion, and Target Recognition XX; 80501C (2011) https://doi.org/10.1117/12.883586
Event: SPIE Defense, Security, and Sensing, 2011, Orlando, Florida, United States

Abstract

The Rapid Serial Visual Presentation (RSVP) protocol for EEG has recently been discovered as a useful tool for highthroughput filtering of images into simple target and nontarget categories [1]. This concept can be extended to the detection of objects and anomalies in images and videos that are of interest to the user (observer) in an applicationspecific context. For example, an image analyst looking for a moving vehicle in wide-area imagery will consider such an object to be target or Item Of Interest (IOI). The ordering of images in the RSVP sequence is expected to have an impact on the detection accuracy. In this paper, we describe an algorithm for learning the RSVP ordering that employs a user interaction step to maximize the detection accuracy while simultaneously minimizing false alarms. With user feedback, the algorithm learns the optimal balance of image distance metrics in order to closely emulate the human's own preference for image order. It then employs the fusion of various perceptual and bio-inspired image metrics to emulate the human's sequencing ability for groups of image chips, which are subsequently used in RSVP trials. Such a method can be employed in human-assisted threat assessment in which the system must scan a wide field of view and report any detections or anomalies to the landscape. In these instances, automated classification methods might fail. We will describe the algorithm and present preliminary results on real-world imagery.

Citation Download Citation

Deepak Khosla, Rajan Bhattacharyya, Penn Tasinga, and David J. Huber "Optimal detection of objects in images and videos using electroencephalography (EEG)", Proc. SPIE 8050, Signal Processing, Sensor Fusion, and Target Recognition XX, 80501C (5 May 2011); https://doi.org/10.1117/12.883586

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available