Tags

Type your tag names separated by a space and hit enter

Native and non-native listeners show similar yet distinct oscillatory dynamics when using gestures to access speech in noise.
Neuroimage. 2019 07 01; 194:55-67.N

Abstract

Listeners are often challenged by adverse listening conditions during language comprehension induced by external factors, such as noise, but also internal factors, such as being a non-native listener. Visible cues, such as semantic information conveyed by iconic gestures, can enhance language comprehension in such situations. Using magnetoencephalography (MEG) we investigated whether spatiotemporal oscillatory dynamics can predict a listener's benefit of iconic gestures during language comprehension in both internally (non-native versus native listeners) and externally (clear/degraded speech) induced adverse listening conditions. Proficient non-native speakers of Dutch were presented with videos in which an actress uttered a degraded or clear verb, accompanied by a gesture or not, and completed a cued-recall task after every video. The behavioral and oscillatory results obtained from non-native listeners were compared to an MEG study where we presented the same stimuli to native listeners (Drijvers et al., 2018a). Non-native listeners demonstrated a similar gestural enhancement effect as native listeners, but overall scored significantly slower on the cued-recall task. In both native and non-native listeners, an alpha/beta power suppression revealed engagement of the extended language network, motor and visual regions during gestural enhancement of degraded speech comprehension, suggesting similar core processes that support unification and lexical access processes. An individual's alpha/beta power modulation predicted the gestural benefit a listener experienced during degraded speech comprehension. Importantly, however, non-native listeners showed less engagement of the mouth area of the primary somatosensory cortex, left insula (beta), LIFG and ATL (alpha) than native listeners, which suggests that non-native listeners might be hindered in processing the degraded phonological cues and coupling them to the semantic information conveyed by the gesture. Native and non-native listeners thus demonstrated similar yet distinct spatiotemporal oscillatory dynamics when recruiting visual cues to disambiguate degraded speech.

Authors+Show Affiliations

Radboud University, Centre for Language Studies, Erasmusplein 1, 6525 HT, Nijmegen, the Netherlands; Radboud University, Donders Institute for Brain, Cognition, and Behaviour, Montessorilaan 3, 6525 HR, Nijmegen, the Netherlands. Electronic address: linda.drijvers@mpi.nl.School of Psychology, Centre for Human Brain Health, University of Birmingham, Hills Building, Birmingham B15 2TT, United Kingdom.Radboud University, Centre for Language Studies, Erasmusplein 1, 6525 HT, Nijmegen, the Netherlands; Radboud University, Donders Institute for Brain, Cognition, and Behaviour, Montessorilaan 3, 6525 HR, Nijmegen, the Netherlands; Max Planck Institute for Psycholinguistics, Wundtlaan 1, 6525 XD, Nijmegen, the Netherlands.School of Psychology, Centre for Human Brain Health, University of Birmingham, Hills Building, Birmingham B15 2TT, United Kingdom.

Pub Type(s)

Journal Article
Research Support, Non-U.S. Gov't

Language

eng

PubMed ID

30905837

Citation

Drijvers, Linda, et al. "Native and Non-native Listeners Show Similar yet Distinct Oscillatory Dynamics when Using Gestures to Access Speech in Noise." NeuroImage, vol. 194, 2019, pp. 55-67.
Drijvers L, van der Plas M, Özyürek A, et al. Native and non-native listeners show similar yet distinct oscillatory dynamics when using gestures to access speech in noise. Neuroimage. 2019;194:55-67.
Drijvers, L., van der Plas, M., Özyürek, A., & Jensen, O. (2019). Native and non-native listeners show similar yet distinct oscillatory dynamics when using gestures to access speech in noise. NeuroImage, 194, 55-67. https://doi.org/10.1016/j.neuroimage.2019.03.032
Drijvers L, et al. Native and Non-native Listeners Show Similar yet Distinct Oscillatory Dynamics when Using Gestures to Access Speech in Noise. Neuroimage. 2019 07 1;194:55-67. PubMed PMID: 30905837.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Native and non-native listeners show similar yet distinct oscillatory dynamics when using gestures to access speech in noise. AU - Drijvers,Linda, AU - van der Plas,Mircea, AU - Özyürek,Asli, AU - Jensen,Ole, Y1 - 2019/03/21/ PY - 2018/09/09/received PY - 2019/03/12/revised PY - 2019/03/15/accepted PY - 2019/3/25/pubmed PY - 2019/12/21/medline PY - 2019/3/26/entrez KW - Degraded speech KW - Gesture KW - Magnetoencephalography KW - Multimodal integration KW - Non-native language comprehension KW - Oscillations KW - Semantics SP - 55 EP - 67 JF - NeuroImage JO - Neuroimage VL - 194 N2 - Listeners are often challenged by adverse listening conditions during language comprehension induced by external factors, such as noise, but also internal factors, such as being a non-native listener. Visible cues, such as semantic information conveyed by iconic gestures, can enhance language comprehension in such situations. Using magnetoencephalography (MEG) we investigated whether spatiotemporal oscillatory dynamics can predict a listener's benefit of iconic gestures during language comprehension in both internally (non-native versus native listeners) and externally (clear/degraded speech) induced adverse listening conditions. Proficient non-native speakers of Dutch were presented with videos in which an actress uttered a degraded or clear verb, accompanied by a gesture or not, and completed a cued-recall task after every video. The behavioral and oscillatory results obtained from non-native listeners were compared to an MEG study where we presented the same stimuli to native listeners (Drijvers et al., 2018a). Non-native listeners demonstrated a similar gestural enhancement effect as native listeners, but overall scored significantly slower on the cued-recall task. In both native and non-native listeners, an alpha/beta power suppression revealed engagement of the extended language network, motor and visual regions during gestural enhancement of degraded speech comprehension, suggesting similar core processes that support unification and lexical access processes. An individual's alpha/beta power modulation predicted the gestural benefit a listener experienced during degraded speech comprehension. Importantly, however, non-native listeners showed less engagement of the mouth area of the primary somatosensory cortex, left insula (beta), LIFG and ATL (alpha) than native listeners, which suggests that non-native listeners might be hindered in processing the degraded phonological cues and coupling them to the semantic information conveyed by the gesture. Native and non-native listeners thus demonstrated similar yet distinct spatiotemporal oscillatory dynamics when recruiting visual cues to disambiguate degraded speech. SN - 1095-9572 UR - https://www.unboundmedicine.com/medline/citation/30905837/Native_and_non_native_listeners_show_similar_yet_distinct_oscillatory_dynamics_when_using_gestures_to_access_speech_in_noise_ L2 - https://linkinghub.elsevier.com/retrieve/pii/S1053-8119(19)30221-6 DB - PRIME DP - Unbound Medicine ER -