10 September 2007 Voice and gesture-based 3D multimedia presentation tool
Author Affiliations +
Proceedings Volume 6777, Multimedia Systems and Applications X; 67770V (2007) https://doi.org/10.1117/12.734783
Event: Optics East, 2007, Boston, MA, United States
Abstract
This paper proposes a 3D multimedia presentation tool that allows the user to manipulate intuitively only through the voice input and the gesture input without using a standard keyboard or a mouse device. The authors developed this system as a presentation tool to be used in a presentation room equipped a large screen like an exhibition room in a museum because, in such a presentation environment, it is better to use voice commands and the gesture pointing input rather than using a keyboard or a mouse device. This system was developed using IntelligentBox, which is a component-based 3D graphics software development system. IntelligentBox has already provided various types of 3D visible, reactive functional components called boxes, e.g., a voice input component and various multimedia handling components. IntelligentBox also provides a dynamic data linkage mechanism called slot-connection that allows the user to develop 3D graphics applications by combining already existing boxes through direct manipulations on a computer screen. Using IntelligentBox, the 3D multimedia presentation tool proposed in this paper was also developed as combined components only through direct manipulations on a computer screen. The authors have already proposed a 3D multimedia presentation tool using a stage metaphor and its voice input interface. This time, we extended the system to make it accept the user gesture input besides voice commands. This paper explains details of the proposed 3D multimedia presentation tool and especially describes its component-based voice and gesture input interfaces.
© (2007) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Hiromichi Fukutake, Hiromichi Fukutake, Yoshiaki Akazawa, Yoshiaki Akazawa, Yoshihiro Okada, Yoshihiro Okada, } "Voice and gesture-based 3D multimedia presentation tool", Proc. SPIE 6777, Multimedia Systems and Applications X, 67770V (10 September 2007); doi: 10.1117/12.734783; https://doi.org/10.1117/12.734783
PROCEEDINGS
12 PAGES


SHARE
RELATED CONTENT

Mpact 2 media processor: balanced 2X performance
Proceedings of SPIE (January 17 1997)
MPEG7-based visual surveillance and retrieval system
Proceedings of SPIE (November 14 2007)
Description scheme for video editing work
Proceedings of SPIE (March 22 2001)
Event-centric media management
Proceedings of SPIE (January 28 2008)

Back to Top