Sculpting 3D worlds with music: advanced texturing techniques

Christian Greuel; Mark T. Bolas; Niko Bolas; Ian E. McDowall

doi:10.1117/12.237453

10 April 1996 Sculpting 3D worlds with music: advanced texturing techniques

Christian Greuel, Mark T. Bolas, Niko Bolas, Ian E. McDowall

Proceedings Volume 2653, Stereoscopic Displays and Virtual Reality Systems III; (1996) https://doi.org/10.1117/12.237453
Event: Electronic Imaging: Science and Technology, 1996, San Jose, CA, United States

Abstract

Sound within the virtual environment is often considered to be secondary to the graphics. In a typical scenario, either audio cues are locally associated with specific 3D objects or a general aural ambiance is supplied in order to alleviate the sterility of an artificial experience. This paper discusses a completely different approach, in which cues are extracted from live or recorded music in order to create geometry and control object behaviors within a computer- generated environment. Advanced texturing techniques used to generate complex stereoscopic images are also discussed. By analyzing music for standard audio characteristics such as rhythm and frequency, information is extracted and repackaged for processing. With the Soundsculpt Toolkit, this data is mapped onto individual objects within the virtual environment, along with one or more predetermined behaviors. Mapping decisions are implemented with a user definable schedule and are based on the aesthetic requirements of directors and designers. This provides for visually active, immersive environments in which virtual objects behave in real-time correlation with the music. The resulting music-driven virtual reality opens up several possibilities for new types of artistic and entertainment experiences, such as fully immersive 3D `music videos' and interactive landscapes for live performance.

Citation Download Citation

Christian Greuel, Mark T. Bolas, Niko Bolas, and Ian E. McDowall "Sculpting 3D worlds with music: advanced texturing techniques", Proc. SPIE 2653, Stereoscopic Displays and Virtual Reality Systems III, (10 April 1996); https://doi.org/10.1117/12.237453

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available