Glass detection and recognition based on the fusion of ultrasonic sensor and RGB-D sensor for the visually impaired

Zhiming Huang; Kaiwei Wang; Kailun Yang; Ruiqi Cheng; Jian Bai

doi:10.1117/12.2325496

9 October 2018 Glass detection and recognition based on the fusion of ultrasonic sensor and RGB-D sensor for the visually impaired

Zhiming Huang, Kaiwei Wang, Kailun Yang, Ruiqi Cheng, Jian Bai

Author Affiliations +

Proceedings Volume 10794, Target and Background Signatures IV; 107940F (2018) https://doi.org/10.1117/12.2325496
Event: SPIE Security + Defence, 2018, Berlin, Germany

Abstract

With the increasing demands of visually impaired people, developing assistive technology to help them travel effectively and safely has been a research hotspot. Red, Green, Blue and Depth (RGB-D) sensor has been widely used to help visually impaired people, but the detection and recognition of glass objects is still a challenge, considering the depth information of glass cannot be obtained correctly. In order to overcome the limitation, we put forward a method to detect glass objects in natural indoor scenes in this paper, which is based on the fusion of ultrasonic sensor and RGB-D sensor on a wearable prototype. Meanwhile, the erroneous depth map of glass object computed by the RGB-D sensor could also be densely recovered. In addition, under some special circumstances, such as facing a mirror or an obstacle within the minimum detectable range of the RGB-D sensor, we use a similar processing method to regain depth information in the invalid area of the original depth map. The experimental results show that the detection range and precision of the RGB-D sensor have been significantly improved with the aid of ultrasonic sensor. The proposed method is proved to be able to detect and recognize common glass obstacles for visually impaired people in real time, which is suitable for real-world indoor navigation assistance.

Conference Presentation

Citation Download Citation

Zhiming Huang, Kaiwei Wang, Kailun Yang, Ruiqi Cheng, and Jian Bai "Glass detection and recognition based on the fusion of ultrasonic sensor and RGB-D sensor for the visually impaired", Proc. SPIE 10794, Target and Background Signatures IV, 107940F (9 October 2018); https://doi.org/10.1117/12.2325496

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available