A neuromorphic system for object detection and classification

Deepak Khosla; Yang Chen; Kyungnam Kim; Shinko Y. Cheng; Alexander L. Honda; Lei Zhang

doi:10.1117/12.2016038

23 May 2013 A neuromorphic system for object detection and classification

Deepak Khosla, Yang Chen, Kyungnam Kim, Shinko Y. Cheng, Alexander L. Honda, Lei Zhang

Proceedings Volume 8745, Signal Processing, Sensor Fusion, and Target Recognition XXII; 87450X (2013) https://doi.org/10.1117/12.2016038
Event: SPIE Defense, Security, and Sensing, 2013, Baltimore, Maryland, United States

Abstract

Unattended object detection, recognition and tracking on unmanned reconnaissance platforms in battlefields and urban spaces are topics of emerging importance. In this paper, we present an unattended object recognition system that automatically detects objects of interest in videos and classifies them into various categories (e.g., person, car, truck, etc.). Our system is inspired by recent findings in visual neuroscience on feed-forward object detection and recognition pipeline and mirrors that via two main neuromorphic modules (1) A front-end detection module that combines form and motion based visual attention to search for and detect “integrated” object percepts as is hypothesized to occur in the human visual pathways; (2) A back-end recognition module that processes only the detected object percepts through a neuromorphic object classification algorithm based on multi-scale convolutional neural networks, which can be efficiently implemented in COTS hardware. Our neuromorphic system was evaluated using a variety of urban area video data collected from both stationary and moving platforms. The data are quite challenging as it includes targets at long ranges, occurring under variable conditions of illuminations and occlusion with high clutter. The experimental results of our system showed excellent detection and classification performance. In addition, the proposed bio-inspired approach is good for hardware implementation due to its low complexity and mapping to off-the-shelf conventional hardware.

Citation Download Citation

Deepak Khosla, Yang Chen, Kyungnam Kim, Shinko Y. Cheng, Alexander L. Honda, and Lei Zhang "A neuromorphic system for object detection and classification", Proc. SPIE 8745, Signal Processing, Sensor Fusion, and Target Recognition XXII, 87450X (23 May 2013); https://doi.org/10.1117/12.2016038

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available