Towards developing a data security aware federated training framework in multi-modal contested environments

Pretom Roy Ovi; Emon Dey; Nirmalya Roy; Aryya Gangopadhyay; Robert F. Erbacher

doi:10.1117/12.2618904

6 June 2022 Towards developing a data security aware federated training framework in multi-modal contested environments

Pretom Roy Ovi, Emon Dey, Nirmalya Roy, Aryya Gangopadhyay, Robert F. Erbacher

Proceedings Volume 12113, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV; 121130M (2022) https://doi.org/10.1117/12.2618904
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

Secure data communication is crucial in contested environments such as battlefields. In such environments, there is always risk of data breach through unauthorized interceptions. This may lead to unauthorized access to tactical information and infiltration into the systems. In this work, we propose a detailed training setup in the federated learning framework for object classification where the raw data will be maintained locally at the edge devices and will not be shared with a central server or with each other. The server sends a global model to edge devices, which is then trained locally at the edge, and the updated parameters are sent back to the central server, where they are aggregated, which takes place iteratively. This setup ensures robustness against malicious cyberattacks as well as reduce communication overhead. Furthermore, to tackle the irregularity in object classification task with a single data modality in such contested environment, a deep learning model incorporating multiple modalities is used as the global model in our proposed federated learning setup. This model can serve as a possible solution in object identification with multi-modal data. We conduct a comprehensive analysis on the importance of multi-modal approach compared to individual modalities within our proposed federate learning setup. We also provide a resource profiling based on memory requirements, training time, and energy usage on two resource constrained devices to demonstrate the feasibility of the proposed approach.

Conference Presentation

Citation Download Citation

Pretom Roy Ovi, Emon Dey, Nirmalya Roy, Aryya Gangopadhyay, and Robert F. Erbacher "Towards developing a data security aware federated training framework in multi-modal contested environments", Proc. SPIE 12113, Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications IV, 121130M (6 June 2022); https://doi.org/10.1117/12.2618904

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available