27 January 2022 Fusion of sparse LIDAR and uncertainty-based 3D vision for accurate depth estimation with Bayesian Kriging
Min Chen, Yuan Feng, Minghui Zhao, Shigang Wang, Qinghua Liang
Author Affiliations +
Abstract

Accurate 3D perception is vital for the localization of mobile robots and autonomous vehicles. Sparse 3D LIDAR scanners and 3D vision sensors (stereo and RGB-D cameras) are commonly used environment perception sensors. The former could provide accurate but sparse-range data, while the latter is dense but full of uncertainty. Since the acquired depth map by each sensor alone could not accurately perceive complex surrounding environment, an innovative probabilistic fusion model based on Bayesian Kriging (BK) is proposed for dense high-precision depth map estimation, to fully utilize the complementary characteristics of the two distinct sensors. Combing the geometric piece-wise planar hypotheses of the scene, the noisy disparity map from the 3D vision sensor is segmented into multiple small planes. In each segmented plane, the BK-based fusion estimator is founded to predict depth for each pixel with sparse scattered LIDAR points. In particular, we focus on analyzing the spatial variation prior and correlation between these two types of data, based on regionalized variable theory. Experiments on various scenes of KITTI stereo datasets are carried out to demonstrate the effectiveness of our algorithm, and validate the superiority compared with existing fusion methods.

© 2022 Society of Photo-Optical Instrumentation Engineers (SPIE) 0091-3286/2022/$28.00 © 2022 SPIE
Min Chen, Yuan Feng, Minghui Zhao, Shigang Wang, and Qinghua Liang "Fusion of sparse LIDAR and uncertainty-based 3D vision for accurate depth estimation with Bayesian Kriging," Optical Engineering 61(1), 013106 (27 January 2022). https://doi.org/10.1117/1.OE.61.1.013106
Received: 11 August 2021; Accepted: 7 January 2022; Published: 27 January 2022
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
LIDAR

3D vision

Sensors

3D modeling

Visual process modeling

Image fusion

Cameras

Back to Top