Tags

Type your tag names separated by a space and hit enter

Combined perception of emotion in pictures and musical sounds.
Brain Res. 2006 Jan 27; 1070(1):160-70.BR

Abstract

Evaluation of emotional scenes requires integration of information from different modality channels, most frequently from audition and vision. Neither the psychological nor neural basis of auditory-visual interactions during the processing of affect is well understood. In this study, possible interactions in affective processing were investigated via event-related potential (ERP) recordings during simultaneous presentation of affective pictures (from IAPS) and affectively sung notes that either matched or mismatched each other in valence. To examine the role of attention in multisensory affect-integration ERPs were recorded in two different rating tasks (voice affect rating, picture affect rating) as participants evaluated the affect communicated in one of the modalities, while that in the other modality was ignored. Both the behavioral and ERP data revealed some, although non-identical, patterns of cross-modal influences; modulation of the ERP-component P2 suggested a relatively early integration of affective information in the attended picture condition, though only for happy picture-voice pairs. In addition, congruent pairing of sad pictures and sad voice stimuli affected the late positive potential (LPP). Responses in the voice affect rating task were overall more likely to be modulated by the concomitant picture's affective valence than vice versa.

Authors+Show Affiliations

Institute of Music Physiology and Musicians' Medicine, University of Music and Drama, Hannover, Hohenzollernstr. 47, D-30161 Hannover, Germany.No affiliation info availableNo affiliation info availableNo affiliation info availableNo affiliation info available

Pub Type(s)

Journal Article
Research Support, N.I.H., Extramural
Research Support, Non-U.S. Gov't

Language

eng

PubMed ID

16403462

Citation

Spreckelmeyer, Katja N., et al. "Combined Perception of Emotion in Pictures and Musical Sounds." Brain Research, vol. 1070, no. 1, 2006, pp. 160-70.
Spreckelmeyer KN, Kutas M, Urbach TP, et al. Combined perception of emotion in pictures and musical sounds. Brain Res. 2006;1070(1):160-70.
Spreckelmeyer, K. N., Kutas, M., Urbach, T. P., Altenmüller, E., & Münte, T. F. (2006). Combined perception of emotion in pictures and musical sounds. Brain Research, 1070(1), 160-70.
Spreckelmeyer KN, et al. Combined Perception of Emotion in Pictures and Musical Sounds. Brain Res. 2006 Jan 27;1070(1):160-70. PubMed PMID: 16403462.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Combined perception of emotion in pictures and musical sounds. AU - Spreckelmeyer,Katja N, AU - Kutas,Marta, AU - Urbach,Thomas P, AU - Altenmüller,Eckart, AU - Münte,Thomas F, Y1 - 2006/01/05/ PY - 2005/03/31/received PY - 2005/10/04/revised PY - 2005/11/19/accepted PY - 2006/1/13/pubmed PY - 2006/6/7/medline PY - 2006/1/13/entrez SP - 160 EP - 70 JF - Brain research JO - Brain Res VL - 1070 IS - 1 N2 - Evaluation of emotional scenes requires integration of information from different modality channels, most frequently from audition and vision. Neither the psychological nor neural basis of auditory-visual interactions during the processing of affect is well understood. In this study, possible interactions in affective processing were investigated via event-related potential (ERP) recordings during simultaneous presentation of affective pictures (from IAPS) and affectively sung notes that either matched or mismatched each other in valence. To examine the role of attention in multisensory affect-integration ERPs were recorded in two different rating tasks (voice affect rating, picture affect rating) as participants evaluated the affect communicated in one of the modalities, while that in the other modality was ignored. Both the behavioral and ERP data revealed some, although non-identical, patterns of cross-modal influences; modulation of the ERP-component P2 suggested a relatively early integration of affective information in the attended picture condition, though only for happy picture-voice pairs. In addition, congruent pairing of sad pictures and sad voice stimuli affected the late positive potential (LPP). Responses in the voice affect rating task were overall more likely to be modulated by the concomitant picture's affective valence than vice versa. SN - 0006-8993 UR - https://www.unboundmedicine.com/medline/citation/16403462/Combined_perception_of_emotion_in_pictures_and_musical_sounds_ L2 - https://linkinghub.elsevier.com/retrieve/pii/S0006-8993(05)01686-0 DB - PRIME DP - Unbound Medicine ER -