Deep learning for automatic target recognition with real and synthetic infrared maritime imagery

Samuel T. Westlake; Timothy N. Volonakis; James Jackman; David B. James; Andy Sherriff

doi:10.1117/12.2573774

20 September 2020 Deep learning for automatic target recognition with real and synthetic infrared maritime imagery

Samuel T. Westlake, Timothy N. Volonakis, James Jackman, David B. James, Andy Sherriff

Proceedings Volume 11543, Artificial Intelligence and Machine Learning in Defense Applications II; 1154309 (2020) https://doi.org/10.1117/12.2573774
Event: SPIE Security + Defence, 2020, Online Only

Abstract

Supervised deep learning algorithms are re-defining the state-of-the-art for object detection and classification. However, training these algorithms requires extensive datasets that are typically expensive and time-consuming to collect. In the field of defence and security, this can become impractical when data is of a sensitive nature, such as infrared imagery of military vessels. Consequently, algorithm development and training are often conducted in synthetic environments, but this brings into question the generalisability of the solution to real world data. In this paper we investigate training deep learning algorithms for infrared automatic target recognition without using real-world infrared data. A large synthetic dataset of infrared images of maritime vessels in the long wave infrared waveband was generated using target-missile engagement simulation software and ten high-fidelity computer-aided design models. Multiple approaches to training a YOLOv3 architecture were explored and subsequently evaluated using a video sequence of real-world infrared data. Experiments demonstrated that supplementing the training data with a small sample of semi-labelled pseudo-IR imagery caused a marked improvement in performance. Despite the absence of real infrared training data, high average precision and recall scores of 99% and 93% respectively were achieved on our real-world test data. To further the development and benchmarking of automatic target recognition algorithms this paper also contributes our dataset of photo-realistic synthetic infrared images.

Conference Presentation

Citation Download Citation

Samuel T. Westlake, Timothy N. Volonakis, James Jackman, David B. James, and Andy Sherriff "Deep learning for automatic target recognition with real and synthetic infrared maritime imagery", Proc. SPIE 11543, Artificial Intelligence and Machine Learning in Defense Applications II, 1154309 (20 September 2020); https://doi.org/10.1117/12.2573774

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available