Simulation of a multispectral, multicamera, off-road autonomous vehicle perception system with Virtual Autonomous Navigation Environment (VANE)

David R. Chambers; Jason Gassaway; Christopher Goodin; Phillip J. Durst

doi:10.1117/12.2194372

13 October 2015 Simulation of a multispectral, multicamera, off-road autonomous vehicle perception system with Virtual Autonomous Navigation Environment (VANE)

David R. Chambers, Jason Gassaway, Christopher Goodin, Phillip J. Durst

Author Affiliations +

Proceedings Volume 9648, Electro-Optical and Infrared Systems: Technology and Applications XII; and Quantum Information Science and Technology; 964802 (2015) https://doi.org/10.1117/12.2194372
Event: SPIE Security + Defence, 2015, Toulouse, France

Abstract

We present a case-study in using specialized, physics-based software for high-fidelity environment and electro-optical sensor modeling in order to produce simulated sensor data that can be used to train a multi-spectral perception system for unmanned ground vehicle navigation. This case-study used the Virtual Autonomous Navigation Environment (VANE) to simulate filtered, multi-spectral imaging sensors. The VANE utilizes ray-tracing and hyperspectral material properties to capture the sensor-environment interaction. In this study we focus on a digital scene of the ERDC test track in Vicksburg, MS that has extremely detailed representation of the vegetation and ground texture. The scene model is used to generate imagery that simulates the output of specialized terrain perception hardware developed by Southwest Research Institute, which consists of stereo pair of 3-channel cameras. The perception system utilizes stereo processing, the multi-spectral responses, and image texture features in order to create a 3-dimensional world model suitable for offroad vehicle navigation, providing depth information and an estimated terrain class label for every pixel by utilizing machine learning. While the process of training the perception system generally involves hand-labeling data collected through manned missions, the ability to generate data for certain environments and lighting conditions represents an enabling technology for deployment in new theaters. We demonstrate an initial capability to simulate data and train the perception system and present the results compared to the system trained with real-world data from the same location.

Citation Download Citation

David R. Chambers, Jason Gassaway, Christopher Goodin, and Phillip J. Durst "Simulation of a multispectral, multicamera, off-road autonomous vehicle perception system with Virtual Autonomous Navigation Environment (VANE)", Proc. SPIE 9648, Electro-Optical and Infrared Systems: Technology and Applications XII; and Quantum Information Science and Technology, 964802 (13 October 2015); https://doi.org/10.1117/12.2194372

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available