Deep reinforcement learning to assist command and control

Song Jun Park; Manuel M. Vindiola; Anne C. Logie; Priya Narayanan; Jared Davies

doi:10.1117/12.2618907

6 June 2022 Deep reinforcement learning to assist command and control

Song Jun Park, Manuel M. Vindiola, Anne C. Logie, Priya Narayanan, Jared Davies

Proceedings Volume 12113, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV; 121131D (2022) https://doi.org/10.1117/12.2618907
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

Multi-domain operations drastically increase the scale and speed required to generate, evaluate, and disseminate command and control (C2) directives. In this work we evaluate the effectiveness of using reinforcement learning (RL) within an Army C2 system to design an artificial intelligence (AI) agent that accelerates the commander and staff’s decision making process. Leveraging RL’s superior ability to explore and exploit produces novel strategies that widen a commander’s decision space without increasing cognitive burden. Integrating RL into an efficient course of action war-gaming simulator and training hundreds of thousands of simulated battles using the DoD supercomputing resources generated an AI that produces acceptable strategic actions during a simulated operation. Moreover, this approach played an unexpected but significant role in strengthening the underlying wargame simulation engine by discovering and exploiting weaknesses in its design. This highlights a future role for the use of RL to test and improve DoD systems during their development.

Conference Presentation

Citation Download Citation

Song Jun Park, Manuel M. Vindiola, Anne C. Logie, Priya Narayanan, and Jared Davies "Deep reinforcement learning to assist command and control", Proc. SPIE 12113, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV, 121131D (6 June 2022); https://doi.org/10.1117/12.2618907

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES + PRESENTATION

DOWNLOAD PAPER SAVE TO MY LIBRARY

WATCH
PRESENTATION

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Artificial intelligence

Computer simulations

Interfaces

Neural networks

Sensors

Weapons

Stochastic processes

RELATED CONTENT

MAD VR machine learning, analysis, and design in virtual...
Proceedings of SPIE (May 03 2018)

Modeling of air operations for course-of-action determination
Proceedings of SPIE (July 15 2002)

Closed loop real time testing of avionics systems using distributed...
Proceedings of SPIE (June 22 1999)

Autonomous agents as air combat simulation adversaries
Proceedings of SPIE (March 23 1993)

Weapon system interoperability testing between target acquisition systems and missile...
Proceedings of SPIE (July 15 1997)

Design of an agile unmanned combat vehicle a product...
Proceedings of SPIE (September 30 2003)

Efficient MRF image-restoration technique using deterministic scale-based optimization
Proceedings of SPIE (March 22 1996)

Subscribe to Digital Library

Receive Erratum Email Alert

Keywords/Phrases

Search In:

Publication Years