Tags

Type your tag names separated by a space and hit enter

Cross-modal interactions in the perception of musical performance.
Cognition. 2006 Aug; 101(1):80-113.C

Abstract

We investigate the dynamics of sensory integration for perceiving musical performance, a complex natural behavior. Thirty musically trained participants saw, heard, or both saw and heard, performances by two clarinetists. All participants used a sliding potentiometer to make continuous judgments of tension (a measure correlated with emotional response) and continuous judgments of phrasing (a measure correlated with perceived musical structure) as performances were presented. The data analysis sought to reveal relations between the sensory modalities (vision and audition) and to quantify the effect of seeing the performances on participants' overall subjective experience of the music. In addition to traditional statistics, functional data analysis techniques were employed to analyze time-varying aspects of the data. The auditory and visual channels were found to convey similar experiences of phrasing but different experiences of tension through much of the performances. We found that visual information served both to augment and to reduce the experience of tension at different points in the musical piece (as revealed by functional linear modeling and functional significance testing). In addition, the musicians' movements served to extend the sense of phrasing, to cue the beginning of new phrases, to indicate musical interpretation, and to anticipate changes in emotional content. Evidence for an interaction effect suggests that there may exist an emergent quality when musical performances are both seen and heard. The investigation augments knowledge of human communicative processes spanning language and music, and involving multiple modalities of emotion and information transfer.

Authors+Show Affiliations

Department of Psychology, McGill University, 1205 Avenue Penfield, Montreal, Que., Canada H2V 2A3.No affiliation info availableNo affiliation info availableNo affiliation info available

Pub Type(s)

Comparative Study
Journal Article
Research Support, Non-U.S. Gov't
Research Support, U.S. Gov't, Non-P.H.S.

Language

eng

PubMed ID

16289067

Citation

Vines, Bradley W., et al. "Cross-modal Interactions in the Perception of Musical Performance." Cognition, vol. 101, no. 1, 2006, pp. 80-113.
Vines BW, Krumhansl CL, Wanderley MM, et al. Cross-modal interactions in the perception of musical performance. Cognition. 2006;101(1):80-113.
Vines, B. W., Krumhansl, C. L., Wanderley, M. M., & Levitin, D. J. (2006). Cross-modal interactions in the perception of musical performance. Cognition, 101(1), 80-113.
Vines BW, et al. Cross-modal Interactions in the Perception of Musical Performance. Cognition. 2006;101(1):80-113. PubMed PMID: 16289067.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Cross-modal interactions in the perception of musical performance. AU - Vines,Bradley W, AU - Krumhansl,Carol L, AU - Wanderley,Marcelo M, AU - Levitin,Daniel J, Y1 - 2005/11/09/ PY - 2005/03/21/received PY - 2005/07/17/revised PY - 2005/09/07/accepted PY - 2005/11/18/pubmed PY - 2006/9/9/medline PY - 2005/11/18/entrez SP - 80 EP - 113 JF - Cognition JO - Cognition VL - 101 IS - 1 N2 - We investigate the dynamics of sensory integration for perceiving musical performance, a complex natural behavior. Thirty musically trained participants saw, heard, or both saw and heard, performances by two clarinetists. All participants used a sliding potentiometer to make continuous judgments of tension (a measure correlated with emotional response) and continuous judgments of phrasing (a measure correlated with perceived musical structure) as performances were presented. The data analysis sought to reveal relations between the sensory modalities (vision and audition) and to quantify the effect of seeing the performances on participants' overall subjective experience of the music. In addition to traditional statistics, functional data analysis techniques were employed to analyze time-varying aspects of the data. The auditory and visual channels were found to convey similar experiences of phrasing but different experiences of tension through much of the performances. We found that visual information served both to augment and to reduce the experience of tension at different points in the musical piece (as revealed by functional linear modeling and functional significance testing). In addition, the musicians' movements served to extend the sense of phrasing, to cue the beginning of new phrases, to indicate musical interpretation, and to anticipate changes in emotional content. Evidence for an interaction effect suggests that there may exist an emergent quality when musical performances are both seen and heard. The investigation augments knowledge of human communicative processes spanning language and music, and involving multiple modalities of emotion and information transfer. SN - 0010-0277 UR - https://www.unboundmedicine.com/medline/citation/16289067/Cross_modal_interactions_in_the_perception_of_musical_performance_ L2 - https://linkinghub.elsevier.com/retrieve/pii/S0010-0277(05)00153-8 DB - PRIME DP - Unbound Medicine ER -