Tags

Type your tag names separated by a space and hit enter

Visual processing affects the neural basis of auditory discrimination.
J Cogn Neurosci. 2008 Dec; 20(12):2175-84.JC

Abstract

The interaction between auditory and visual speech streams is a seamless and surprisingly effective process. An intriguing example is the "McGurk effect": The acoustic syllable /ba/ presented simultaneously with a mouth articulating /ga/ is typically heard as /da/ [McGurk, H., & MacDonald, J. Hearing lips and seeing voices. Nature, 264, 746-748, 1976]. Previous studies have demonstrated the interaction of auditory and visual streams at the auditory cortex level, but the importance of these interactions for the qualitative perception change remained unclear because the change could result from interactions at higher processing levels as well. In our electroencephalogram experiment, we combined the McGurk effect with mismatch negativity (MMN), a response that is elicited in the auditory cortex at a latency of 100-250 msec by any above-threshold change in a sequence of repetitive sounds. An "odd-ball" sequence of acoustic stimuli consisting of frequent /va/ syllables (standards) and infrequent /ba/ syllables (deviants) was presented to 11 participants. Deviant stimuli in the unisensory acoustic stimulus sequence elicited a typical MMN, reflecting discrimination of acoustic features in the auditory cortex. When the acoustic stimuli were dubbed onto a video of a mouth constantly articulating /va/, the deviant acoustic /ba/ was heard as /va/ due to the McGurk effect and was indistinguishable from the standards. Importantly, such deviants did not elicit MMN, indicating that the auditory cortex failed to discriminate between the acoustic stimuli. Our findings show that visual stream can qualitatively change the auditory percept at the auditory cortex level, profoundly influencing the auditory cortex mechanisms underlying early sound discrimination.

Authors+Show Affiliations

Laboratory of Computational Engineering, Helsinki University of Technology, Finland. dkislyuk@gmail.comNo affiliation info availableNo affiliation info available

Pub Type(s)

Journal Article
Research Support, Non-U.S. Gov't

Language

eng

PubMed ID

18457500

Citation

Kislyuk, Daniel S., et al. "Visual Processing Affects the Neural Basis of Auditory Discrimination." Journal of Cognitive Neuroscience, vol. 20, no. 12, 2008, pp. 2175-84.
Kislyuk DS, Möttönen R, Sams M. Visual processing affects the neural basis of auditory discrimination. J Cogn Neurosci. 2008;20(12):2175-84.
Kislyuk, D. S., Möttönen, R., & Sams, M. (2008). Visual processing affects the neural basis of auditory discrimination. Journal of Cognitive Neuroscience, 20(12), 2175-84. https://doi.org/10.1162/jocn.2008.20152
Kislyuk DS, Möttönen R, Sams M. Visual Processing Affects the Neural Basis of Auditory Discrimination. J Cogn Neurosci. 2008;20(12):2175-84. PubMed PMID: 18457500.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Visual processing affects the neural basis of auditory discrimination. AU - Kislyuk,Daniel S, AU - Möttönen,Riikka, AU - Sams,Mikko, PY - 2008/5/7/pubmed PY - 2009/4/15/medline PY - 2008/5/7/entrez SP - 2175 EP - 84 JF - Journal of cognitive neuroscience JO - J Cogn Neurosci VL - 20 IS - 12 N2 - The interaction between auditory and visual speech streams is a seamless and surprisingly effective process. An intriguing example is the "McGurk effect": The acoustic syllable /ba/ presented simultaneously with a mouth articulating /ga/ is typically heard as /da/ [McGurk, H., & MacDonald, J. Hearing lips and seeing voices. Nature, 264, 746-748, 1976]. Previous studies have demonstrated the interaction of auditory and visual streams at the auditory cortex level, but the importance of these interactions for the qualitative perception change remained unclear because the change could result from interactions at higher processing levels as well. In our electroencephalogram experiment, we combined the McGurk effect with mismatch negativity (MMN), a response that is elicited in the auditory cortex at a latency of 100-250 msec by any above-threshold change in a sequence of repetitive sounds. An "odd-ball" sequence of acoustic stimuli consisting of frequent /va/ syllables (standards) and infrequent /ba/ syllables (deviants) was presented to 11 participants. Deviant stimuli in the unisensory acoustic stimulus sequence elicited a typical MMN, reflecting discrimination of acoustic features in the auditory cortex. When the acoustic stimuli were dubbed onto a video of a mouth constantly articulating /va/, the deviant acoustic /ba/ was heard as /va/ due to the McGurk effect and was indistinguishable from the standards. Importantly, such deviants did not elicit MMN, indicating that the auditory cortex failed to discriminate between the acoustic stimuli. Our findings show that visual stream can qualitatively change the auditory percept at the auditory cortex level, profoundly influencing the auditory cortex mechanisms underlying early sound discrimination. SN - 0898-929X UR - https://www.unboundmedicine.com/medline/citation/18457500/Visual_processing_affects_the_neural_basis_of_auditory_discrimination_ L2 - https://www.mitpressjournals.org/doi/10.1162/jocn.2008.20152?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub=pubmed DB - PRIME DP - Unbound Medicine ER -