Paper
8 December 2023 Enabling technologies for multi-robot human collaboration
C. Patrick Yue, Hoi Chuen Cheng, Ziyang Hong
Author Affiliations +
Proceedings Volume 12943, International Workshop on Signal Processing and Machine Learning (WSPML 2023); 1294317 (2023) https://doi.org/10.1117/12.3017942
Event: International Workshop on Signal Processing and Machine Learning (WSPML 2023), 2023, Hangzhou, ZJ, China
Abstract
This paper presents several advances in indoor navigation, multi-agent systems, 3D perception, and 360° imaging for multi-robot human collaboration. First, we proposed a light-assisted dead reckoning (LiDR) system integrating visible light positioning (VLP) and pedestrian dead reckoning (PDR) for high-accuracy indoor localization within 0.7 m average error. VLP provides calibration for PDR drift utilizing light-emitting diode (LED) lights enabled by visible light communication technology. Second, developments in multi-agent reinforcement learning for robotics are explored, emphasizing path planning and collaboration in partially observable environments. The impact of field-of-view settings on communication-based coordination is investigated. For 3D perception, a cross-dimensional refinement methodology is introduced leveraging 2D image features to enhance geometrical details in real-time volumetric reconstruction. This joint 3D geometry and semantic prediction addresses limitations of current visual methods. Finally, solutions for calibration and pose estimation are proposed enabling 360° cameras for 3D reconstruction in the perception. Equirectangular projections are converted to cube maps, then aligned via rigid body transformations based on robot location. Together, these innovations in indoor navigation, multi-agent systems, 3D perception, and 360° imaging showcase critical technologies for emerging applications in localization, robotics, and immersive analytics. The methodologies presented provide comprehensive solutions to key challenges in these domains.
(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.
C. Patrick Yue, Hoi Chuen Cheng, and Ziyang Hong "Enabling technologies for multi-robot human collaboration", Proc. SPIE 12943, International Workshop on Signal Processing and Machine Learning (WSPML 2023), 1294317 (8 December 2023); https://doi.org/10.1117/12.3017942
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
Back to Top