Color-feature-based environmental synchronization in VR-aided teleoperation

Jianchao Zeng; Yudong Yang; Guang-you Xu

doi:10.1117/12.263000

17 December 1996 Color-feature-based environmental synchronization in VR-aided teleoperation

Jianchao Zeng, Yudong Yang, Guang-you Xu

Proceedings Volume 2901, Telemanipulator and Telepresence Technologies III; (1996) https://doi.org/10.1117/12.263000
Event: Photonics East '96, 1996, Boston, MA, United States

Abstract

In teleoperation situations where virtual environments are employed and fine operation is needed, it is crucial to dynamically keep the virtual environment consistent with the real remote environment. This is especially important when the remote site is at a great distance, such as in a space station, and therefore large time delays exist during the process of teleoperation. In this paper, we propose an automatic calibration method which dynamically determines the difference in 3D position and orientation between virtual and real environments by using a new color image matching technique which is based on gradients of both gray levels and color information. During the process of model building, significant color features in the real environment, either natural or specially prepared, are picked up and mapped onto the corresponding environment model positions. During the process of teleoperation, color images are taken by a camera mounted on a manipulator. These images are analyzed and features are extracted and matched with those in the model in real time. The 3D poses and positions of the camera in the real environment are calculated and then compared with those in the virtual environment in order to determine differences between them. Feature correspondences are determined based on color attributes and geometric relations. A simplified closed-form solution for 3D location of a 4-DOF mobile camera is given. Experimental results show the effectiveness of this dynamic calibration approach.

Citation Download Citation

Jianchao Zeng, Yudong Yang, and Guang-you Xu "Color-feature-based environmental synchronization in VR-aided teleoperation", Proc. SPIE 2901, Telemanipulator and Telepresence Technologies III, (17 December 1996); https://doi.org/10.1117/12.263000

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Calibration

Image segmentation

Virtual reality

3D modeling

Image processing

RGB color model

Show All Keywords

Keywords/Phrases

Search In:

Publication Years