9 October 1998 TV-view-into-reality metaphor: introducing computer vision into virtual worlds
Author Affiliations +
Proceedings Volume 3523, Sensor Fusion and Decentralized Control in Robotic Systems; (1998) https://doi.org/10.1117/12.326994
Event: Photonics East (ISAM, VVDC, IEMB), 1998, Boston, MA, United States
Smart man machine interfaces turn out to be a key technology for service robots, for automation applications in industrial environments as well as in future scenarios for applications in space. For either field, the use of virtual reality (VR) techniques showed a great potential. At the IRF a virtual reality system was developed and implemented which allows the intuitive control of a multi-robot system and different automation systems under one unified VR framework. As the developed multi-robot system is also employed for space application, the intuitive commanding of inspection and teleoperation sequences is of great interest. In order to facilitate teleoperation and inspection, we make use of several metaphors and a vision system as an `intelligent sensor'. One major metaphor to be presented in the paper is the `TV-view into reality', where a TV-set is displayed in the virtual world with images of the real world being mapped onto the screen as textures. The user can move the TV-set in the virtual world and, as the image generating camera is carried by a robot, the camera-viewpoint changes accordingly. Thus the user can explore the physical world `behind' the virtual world, which is ideal for inspection and teleoperation tasks. By means of real world images and with different measurement-services provided by the underlying 3D vision system, the user can thus interactively build up or refine the virtual world according to the physical world he is watching through the TV-set.
© (1998) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Eckhard Freund, Eckhard Freund, Horst Knoche, Horst Knoche, Juergen Rossmann, Juergen Rossmann, } "TV-view-into-reality metaphor: introducing computer vision into virtual worlds", Proc. SPIE 3523, Sensor Fusion and Decentralized Control in Robotic Systems, (9 October 1998); doi: 10.1117/12.326994; https://doi.org/10.1117/12.326994


Intersection mappings for stereo vision
Proceedings of SPIE (February 29 1992)
Camera calibration based on coplanar points
Proceedings of SPIE (February 23 1993)
Survey On Vision Systems For Advanced Automation In Japan
Proceedings of SPIE (October 09 1979)

Back to Top