Multisource deep learning for situation awareness

Erik Blasch; Zheng Liu; Yufeng Zheng; Uttam Majumder; Alex Aved; Peter Zulch

doi:10.1117/12.2519236

14 May 2019 Multisource deep learning for situation awareness

Erik Blasch, Zheng Liu, Yufeng Zheng, Uttam Majumder, Alex Aved, Peter Zulch

Proceedings Volume 10988, Automatic Target Recognition XXIX; 109880M (2019) https://doi.org/10.1117/12.2519236
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

The resurgence of interest in artificial intelligence (AI) stems from impressive deep learning (DL) performance such as hierarchical supervised training using a Convolutional Neural Network (CNN). Current DL methods should provide contextual reasoning, explainable results, and repeatable understanding that require evaluation methods. This paper discusses DL techniques using multimodal (or multisource) information that extend measures of performance (MOP). Examples of joint multi-modal learning include imagery and text, video and radar, and other common sensor types. Issues with joint multimodal learning challenge many current methods and care is needed to apply machine learning methods. Results from Deep Multimodal Image Fusion (DMIF) using Electro-optical and infrared data demonstrate performance modeling based on distance to better understand DL robustness and quality to provide situation awareness.

Conference Presentation

Citation Download Citation

Erik Blasch, Zheng Liu, Yufeng Zheng, Uttam Majumder, Alex Aved, and Peter Zulch "Multisource deep learning for situation awareness", Proc. SPIE 10988, Automatic Target Recognition XXIX, 109880M (14 May 2019); https://doi.org/10.1117/12.2519236

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available