Music in film and animation: experimental semiotics applied to visual, sound and musical structures

Roger A. Kendall

doi:10.1117/12.849097

22 February 2010 Music in film and animation: experimental semiotics applied to visual, sound and musical structures

Roger A. Kendall

Author Affiliations +

Proceedings Volume 7527, Human Vision and Electronic Imaging XV; 752703 (2010) https://doi.org/10.1117/12.849097
Event: IS&T/SPIE Electronic Imaging, 2010, San Jose, California, United States

Abstract

The relationship of music to film has only recently received the attention of experimental psychologists and quantificational musicologists. This paper outlines theory, semiotical analysis, and experimental results using relations among variables of temporally organized visuals and music. 1. A comparison and contrast is developed among the ideas in semiotics and experimental research, including historical and recent developments. 2. Musicological Exploration: The resulting multidimensional structures of associative meanings, iconic meanings, and embodied meanings are applied to the analysis and interpretation of a range of film with music. 3. Experimental Verification: A series of experiments testing the perceptual fit of musical and visual patterns layered together in animations determined goodness of fit between all pattern combinations, results of which confirmed aspects of the theory. However, exceptions were found when the complexity of the stratified stimuli resulted in cognitive overload.

Citation Download Citation

Roger A. Kendall "Music in film and animation: experimental semiotics applied to visual, sound and musical structures", Proc. SPIE 7527, Human Vision and Electronic Imaging XV, 752703 (22 February 2010); https://doi.org/10.1117/12.849097

Access the abstract

PROCEEDINGS
13 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Visualization

Composites

Analytical research

Visual process modeling

Visual analytics

Cognitive modeling

Solid modeling

Show All Keywords

RELATED CONTENT

Adaptive geovisualization of mobile map based on Voronoi neighborhoods
Proceedings of SPIE (January 04 2006)

Extraction of composite visual objects from audiovisual materials
Proceedings of SPIE (August 24 1999)

HCPN: multimedia synchronization with user interaction and hypermedia
Proceedings of SPIE (September 16 1996)

Using a human cognition model in the creation of collaborative...
Proceedings of SPIE (April 15 2008)

The time dependent reorderable matrix method for visualizing evolving tabular...
Proceedings of SPIE (March 11 2005)

Research on classification and application of sports images based on...
Proceedings of SPIE (October 05 2021)

Media construction patterns abstraction and reuse in multimedia application...
Proceedings of SPIE (December 22 2000)

Subscribe to Digital Library

Receive Erratum Email Alert

Show All Keywords

Keywords/Phrases

Search In:

Publication Years