This thesis investigates cross-modal interactions in auditory and visual perception, focusing on the perception of expressive musical performances. A primary aim of the work is to advance knowledge pertaining to how and when musicians' body movements influence an observer's overall experience. Three studies, comprising two multi-factor experimental investigations and one theoretical contribution, explore the multi-modal experience of musical performance. The two empirical chapters investigate, respectively, (1) the real-time experience of musical structure and musical emotion, comparing unimodal and multimodal conditions, and (2) the multidimensional structure of affective responses to musical performance, as a function of sensory modalities and performance intentions. The theoretical chapter develops a class of quantitative models for studying real-time phenomena in music (in particular) and time-series data (in general). An original contribution of this thesis is to quantify the ways in which the auditory and visual components of musical performance contribute singly and in interaction with one another to overall experience. The studies show that seeing a musician performing can augment, complement and interact with the auditory component to significantly influence music perception. These results are relevant to, and inform theories on, multi-sensory integration, emotion, and music cognition, as well as performance practice and audio-video media.
| Identifer | oai:union.ndltd.org:LACETR/oai:collectionscanada.gc.ca:QMM.86058 |
| Date | January 2005 |
| Creators | Vines, Bradley W. |
| Publisher | McGill University |
| Source Sets | Library and Archives Canada ETDs Repository / Centre d'archives des thèses électroniques de Bibliothèque et Archives Canada |
| Language | English |
| Detected Language | English |
| Type | Electronic Thesis or Dissertation |
| Format | application/pdf |
| Coverage | Doctor of Philosophy (Department of Psychology.) |
| Rights | All items in eScholarship@McGill are protected by copyright with all rights reserved unless otherwise indicated. |
| Relation | alephsysno: 002271151, proquestno: AAINR21708, Theses scanned by UMI/ProQuest. |
Page generated in 0.0022 seconds