Efforts are underway across the defense and commercial industries to develop cross-reality (XR), multi-user operation centers in which human users can perform their work while aided by intelligent systems. At their core is the objective to accelerate decision-making and improve efficiency and accuracy. However, presenting data to users in an XR, multi-dimensional environment results in a dramatic increase in extraneous information density. Intelligent systems offer a potential mechanism for mitigating information overload while ensuring that critical and anomalous data is brought to the attention of the human users in an immersive interface. This paper describes such a prototype system that combines real and synthetic motion sensors which, upon detection of an event, send a captured image for processing by a YOLO cluster. Finally, we describe how a future system can integrate a decision-making component for evaluation of the resulting metadata to determine whether to inject the results into an XR environment for presentation to human users.
Conference Committee Involvement (2)
Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations II
12 April 2021 | Online Only, Florida, United States
Virtual, Augmented, and Mixed Reality (XR) Technology for Multi-Domain Operations
27 April 2020 | Online Only, California, United States