Multi-agent collaboration with ergodic spatial distributions

Derrik E. Asher; Erin Zaroukian; Brandon Perelman; Jake Perret; Rolando Fernandez; Blaine Hoffman; Sebastian S. Rodriguez

doi:10.1117/12.2559482

21 April 2020 Multi-agent collaboration with ergodic spatial distributions

Derrik E. Asher, Erin Zaroukian, Brandon Perelman, Jake Perret, Rolando Fernandez, Blaine Hoffman, Sebastian S. Rodriguez

Author Affiliations +

Proceedings Volume 11413, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications II; 114131N (2020) https://doi.org/10.1117/12.2559482
Event: SPIE Defense + Commercial Sensing, 2020, Online Only

Abstract

When considering collaboration among agents in multi-agent systems, individual and team measures of performance are used to describe the collaboration. Typically, the definition of collaboration is limited in that it is only indicative of coordination required for a small class of tasks wherein this coordination is necessary for task completion (e.g. two or more agents needed to lift a heavy object). In this work, we aim to present a method that may be used to classify individual and group behaviors, enabling the measurement of collaboration among agents. We demonstrate the capability to use performance and behavioral data from computational learning agents in a predator-prey pursuit task to produce ergodic spatial distributions. Ergodicity is shown quantitatively and used to benchmark performance. The ergodic distributions shown, reflect the learned policies developed through multi-agent reinforcement learning (MARL). We also demonstrate that independently trained models produce distinctly different behavior, as revealed through ergodic spatial distributions. The ergodicity of the agents’ behavior provides both a potential path for classifying group behavior, predicting performance of group behavior with novel partners, and a quantifiable measure of collaboration built from explicitly aligned goals (i.e., cooperation) as a result of behavioral interdependencies.

Citation Download Citation

Derrik E. Asher, Erin Zaroukian, Brandon Perelman, Jake Perret, Rolando Fernandez, Blaine Hoffman, and Sebastian S. Rodriguez "Multi-agent collaboration with ergodic spatial distributions", Proc. SPIE 11413, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications II, 114131N (21 April 2020); https://doi.org/10.1117/12.2559482

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available