Compressive object tracking and classification using deep learning for infrared videos

Chiman Kwan; Bryan Chou; Jonathan Yang; Trac Tran

doi:10.1117/12.2518490

13 May 2019 Compressive object tracking and classification using deep learning for infrared videos

Chiman Kwan, Bryan Chou, Jonathan Yang, Trac Tran

Proceedings Volume 10995, Pattern Recognition and Tracking XXX; 1099506 (2019) https://doi.org/10.1117/12.2518490
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

Object tracking and classification in infrared videos are challenging due to large variations in illumination, target sizes, and target orientations. Moreover, if the infrared videos only generate compressive measurements, then it will be even more difficult to perform target tracking and classification directly in the compressive measurement domain, as many conventional trackers and classifiers can only handle reconstructed frames from compressive measurements. This paper summarizes our research effort on target tracking and classification directly in the compressive measurement domain. We focus on one special type of compressive measurement using pixel subsampling. That is, the original pixels in the video frames are randomly subsampled. Even in such special compressive sensing setting, conventional trackers do not work in a satisfactory manner. We propose a deep learning approach that integrates YOLO (You Only Look Once) and ResNet (residual network) for multiple target tracking and classification. YOLO is used for multiple target tracking and ResNet is for target classification. Extensive experiments using short wave infrared (SWIR) videos demonstrated the efficacy of the proposed approach even though the training data are very scarce.

Conference Presentation

Citation Download Citation

Chiman Kwan, Bryan Chou, Jonathan Yang, and Trac Tran "Compressive object tracking and classification using deep learning for infrared videos", Proc. SPIE 10995, Pattern Recognition and Tracking XXX, 1099506 (13 May 2019); https://doi.org/10.1117/12.2518490

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available