Paper
26 June 2023 LiDAR and RGB camera based feature extraction and evaluation for adverse weather driving
Author Affiliations +
Abstract
Modern automobiles are commonly equipped with a variety of perception modalities, i. e. sensors, to implement various levels of Advanced Driver Assistance Systems (ADAS). The main sensing modalities include camera, light detection and ranging (LiDAR), radar, as well as inertial measurement and global positioning devices. In addition, ultrasonic and acoustic sensors complete the possible perception modalities. ADAS features autonomous driving systems that have been initially developed assuming ideal perception, i.e., weather conditions; however, in reality, the quality of a sensor modality may degrade significantly due to adherent dirt, dust, fog, wet weather, or changing illumination conditions on the road. It is important to quantitatively study the degradation of sensor modalities in non-ideal conditions such as fog, rain, snow, bright sunlight, dust, etc., in order to evaluate sensor degradation and its effects on higher-level functionalities such as lane-keeping, object detection, recognition, and tracking, as well as ego-motion estimation and localization. This paper quantitatively examines the variability of several LiDAR and RGB camera-based features in variable weather conditions, including clear sky, overcast, fog, rain, and snow. Specifically, we derived LiDAR point-cloud-based features such as mean and standard deviation of distances and point cloud size. Also, image color space features were examined, in addition to blurriness and structural detail. Furthermore, we perform feature selection to explore the importance of various combinations of features for the prediction of road weather conditions.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Joshua Olusola, Jumana Abu-Khalaf, Sidike Paheding, and Nathir Rawashdeh "LiDAR and RGB camera based feature extraction and evaluation for adverse weather driving", Proc. SPIE 12540, Autonomous Systems: Sensors, Processing, and Security for Ground, Air, Sea, and Space Vehicles and Infrastructure 2023, 125400I (26 June 2023); https://doi.org/10.1117/12.2664734
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
LIDAR

Cameras

Point clouds

RGB color model

Image quality

Roads

Sensors

Back to Top