Understanding of multi-domain battle challenges: AI/ML and the day/night thermal variability of targets

Patrick Rauss; Dalton Rosario

doi:10.1117/12.2517510

10 May 2019 Understanding of multi-domain battle challenges: AI/ML and the day/night thermal variability of targets

Patrick Rauss, Dalton Rosario

Proceedings Volume 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications; 110061W (2019) https://doi.org/10.1117/12.2517510
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

Better understanding of Multi Domain Battle (MDB) challenges in complex military environments may start by gaining a basic scientific appreciation of the level of generalization and scalability offered by Machine Learning (ML) solutions designed, trained and optimized to achieve a single, specific task, continuously daytime and nighttime. We examine the generalization and scalability promises of a modern deep ML solution, applied to a unique spatial-spectral dataset that consists of blackbody calibrated, longwave infrared spectra of a fixed target site containing three painted metal surrogate tanks deployed in a field of mixed vegetation. Data was collected at roughly six minute intervals, nearly continuously, for over a year. This includes collection in many atmospheric conditions (rain, snow, sleet, fog, etc.) throughout the year. This paper focuses on data collected by a Telops Hyper-Cam from a 65 meter observation tower located at slant range of roughly 550 meters, from the targets. The dataset is very complex. There are no obvious spectral signatures from the target surfaces. The complexity is due in part to the natural variations of the various types of vegetation, cloud presence, and the changing solar loading conditions over time. This is precisely the environment MDB applications must function in. We detail some of the many training sets extracted to train different deep learning stacked auto encoder networks. We present performance results with receiver operator characteristic curves, confusion matrices, metric-vs-time plots, and classification maps. We show performance of ML models trained with data from various time windows, including over complete diurnal cycles and their performance processing data from different days and environmental conditions.

Citation Download Citation

Patrick Rauss and Dalton Rosario "Understanding of multi-domain battle challenges: AI/ML and the day/night thermal variability of targets", Proc. SPIE 11006, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications, 110061W (10 May 2019); https://doi.org/10.1117/12.2517510

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
19 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Detection and tracking algorithms

Long wavelength infrared

Network architectures

Infrared radiation

Sensors

Sun

Machine learning

Show All Keywords

Keywords/Phrases

Search In:

Publication Years