Translator Disclaimer
13 October 2015 Simulation of a multispectral, multicamera, off-road autonomous vehicle perception system with Virtual Autonomous Navigation Environment (VANE)
Author Affiliations +
Abstract
We present a case-study in using specialized, physics-based software for high-fidelity environment and electro-optical sensor modeling in order to produce simulated sensor data that can be used to train a multi-spectral perception system for unmanned ground vehicle navigation. This case-study used the Virtual Autonomous Navigation Environment (VANE) to simulate filtered, multi-spectral imaging sensors. The VANE utilizes ray-tracing and hyperspectral material properties to capture the sensor-environment interaction. In this study we focus on a digital scene of the ERDC test track in Vicksburg, MS that has extremely detailed representation of the vegetation and ground texture. The scene model is used to generate imagery that simulates the output of specialized terrain perception hardware developed by Southwest Research Institute, which consists of stereo pair of 3-channel cameras. The perception system utilizes stereo processing, the multi-spectral responses, and image texture features in order to create a 3-dimensional world model suitable for offroad vehicle navigation, providing depth information and an estimated terrain class label for every pixel by utilizing machine learning. While the process of training the perception system generally involves hand-labeling data collected through manned missions, the ability to generate data for certain environments and lighting conditions represents an enabling technology for deployment in new theaters. We demonstrate an initial capability to simulate data and train the perception system and present the results compared to the system trained with real-world data from the same location.
© (2015) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
David R. Chambers, Jason Gassaway, Christopher Goodin, and Phillip J. Durst "Simulation of a multispectral, multicamera, off-road autonomous vehicle perception system with Virtual Autonomous Navigation Environment (VANE)", Proc. SPIE 9648, Electro-Optical and Infrared Systems: Technology and Applications XII; and Quantum Information Science and Technology, 964802 (13 October 2015); https://doi.org/10.1117/12.2194372
PROCEEDINGS
12 PAGES


SHARE
Advertisement
Advertisement
RELATED CONTENT


Back to Top