Framework for digital twin creation in off-road environments from LiDAR scans

Jingdao Chen; Mikias Gugssa; Justin Yee; Jun Wang; Christopher Goodin; Athish Ram Das

doi:10.1117/12.2663632

13 June 2023 Framework for digital twin creation in off-road environments from LiDAR scans

Jingdao Chen, Mikias Gugssa, Justin Yee, Jun Wang, Christopher Goodin, Athish Ram Das

Proceedings Volume 12529, Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications; 125290F (2023) https://doi.org/10.1117/12.2663632
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Abstract

Digital twins of real environments are valuable tools for generating realistic synthetic data and performing simulations with artificial intelligence and machine learning models. Creating digital twins of urban, on-road environments have been extensively researched in the light of rising momentum in urban planning and autonomous vehicle systems; yet creating digital twins of rugged, off-road environments such as forests, farms, and mountainous areas is still poorly studied. In this work, we propose a pipeline to produce digital twins of off-road environments with a focus on modeling vegetation and uneven terrain. A point cloud map of the off-road environment is first reconstructed using LiDAR scans paired with scan registration algorithms. Terrain segmentation, vegetation segmentation, and Euclidean clustering are applied to separate point cloud objects into individual entities within the digital twin model. Experimental validation is carried out using LiDAR scans collected from an off-road proving ground at the Center of Advanced Vehicular Systems (CAVS) in Mississippi State University. A prototype system is demonstrated with the Mississippi State University Autonomous Vehicle Simulator (MAVS), and the source code and data are publicly available∗. The proposed framework has a wide range of applications including virtual autonomous vehicle testing, synthetic data generation, and training of AI models.

Conference Presentation

Citation Download Citation

Jingdao Chen, Mikias Gugssa, Justin Yee, Jun Wang, Christopher Goodin, and Athish Ram Das "Framework for digital twin creation in off-road environments from LiDAR scans", Proc. SPIE 12529, Synthetic Data for Artificial Intelligence and Machine Learning: Tools, Techniques, and Applications, 125290F (13 June 2023); https://doi.org/10.1117/12.2663632

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available