Tags

Type your tag names separated by a space and hit enter

Auditory-Articulatory Neural Alignment between Listener and Speaker during Verbal Communication.

Abstract

Whether auditory processing of speech relies on reference to the articulatory motor information of speaker remains elusive. Here, we addressed this issue under a two-brain framework. Functional magnetic resonance imaging was applied to record the brain activities of speakers when telling real-life stories and later of listeners when listening to the audio recordings of these stories. Based on between-brain seed-to-voxel correlation analyses, we revealed that neural dynamics in listeners' auditory temporal cortex are temporally coupled with the dynamics in the speaker's larynx/phonation area. Moreover, the coupling response in listener's left auditory temporal cortex follows the hierarchical organization for speech processing, with response lags in A1+, STG/STS, and MTG increasing linearly. Further, listeners showing greater coupling responses understand the speech better. When comprehension fails, such interbrain auditory-articulation coupling vanishes substantially. These findings suggest that a listener's auditory system and a speaker's articulatory system are inherently aligned during naturalistic verbal interaction, and such alignment is associated with high-level information transfer from the speaker to the listener. Our study provides reliable evidence supporting that references to the articulatory motor information of speaker facilitate speech comprehension under a naturalistic scene.

Authors+Show Affiliations

State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, People's Republic of China. Department of Psychology, Sun Yat-sen University, Guangzhou 510006, People's Republic of China.State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, People's Republic of China.State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, People's Republic of China.Max Planck UCL Centre for Computational Psychiatry and Ageing Research, Max Planck Institute for Human Development, Lentzeallee 94, Berlin 14195, Germany.State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, People's Republic of China.Key Laboratory of Cognition and Personality (SWU), Ministry of Education & Department of Psychology, Southwest University, Chongqing 400715, People's Republic of China.Key Laboratory of Cognition and Personality (SWU), Ministry of Education & Department of Psychology, Southwest University, Chongqing 400715, People's Republic of China.State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing 100875, People's Republic of China.

Pub Type(s)

Journal Article

Language

eng

PubMed ID

31318013

Citation

Liu, Lanfang, et al. "Auditory-Articulatory Neural Alignment Between Listener and Speaker During Verbal Communication." Cerebral Cortex (New York, N.Y. : 1991), 2019.
Liu L, Zhang Y, Zhou Q, et al. Auditory-Articulatory Neural Alignment between Listener and Speaker during Verbal Communication. Cereb Cortex. 2019.
Liu, L., Zhang, Y., Zhou, Q., Garrett, D. D., Lu, C., Chen, A., ... Ding, G. (2019). Auditory-Articulatory Neural Alignment between Listener and Speaker during Verbal Communication. Cerebral Cortex (New York, N.Y. : 1991), doi:10.1093/cercor/bhz138.
Liu L, et al. Auditory-Articulatory Neural Alignment Between Listener and Speaker During Verbal Communication. Cereb Cortex. 2019 Jul 18; PubMed PMID: 31318013.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Auditory-Articulatory Neural Alignment between Listener and Speaker during Verbal Communication. AU - Liu,Lanfang, AU - Zhang,Yuxuan, AU - Zhou,Qi, AU - Garrett,Douglas D, AU - Lu,Chunming, AU - Chen,Antao, AU - Qiu,Jiang, AU - Ding,Guosheng, Y1 - 2019/07/18/ PY - 2018/11/01/received PY - 2019/05/20/revised PY - 2019/05/25/accepted PY - 2019/7/19/entrez KW - auditory–articulatory interaction KW - interbrain neural coupling KW - speech comprehension JF - Cerebral cortex (New York, N.Y. : 1991) JO - Cereb. Cortex N2 - Whether auditory processing of speech relies on reference to the articulatory motor information of speaker remains elusive. Here, we addressed this issue under a two-brain framework. Functional magnetic resonance imaging was applied to record the brain activities of speakers when telling real-life stories and later of listeners when listening to the audio recordings of these stories. Based on between-brain seed-to-voxel correlation analyses, we revealed that neural dynamics in listeners' auditory temporal cortex are temporally coupled with the dynamics in the speaker's larynx/phonation area. Moreover, the coupling response in listener's left auditory temporal cortex follows the hierarchical organization for speech processing, with response lags in A1+, STG/STS, and MTG increasing linearly. Further, listeners showing greater coupling responses understand the speech better. When comprehension fails, such interbrain auditory-articulation coupling vanishes substantially. These findings suggest that a listener's auditory system and a speaker's articulatory system are inherently aligned during naturalistic verbal interaction, and such alignment is associated with high-level information transfer from the speaker to the listener. Our study provides reliable evidence supporting that references to the articulatory motor information of speaker facilitate speech comprehension under a naturalistic scene. SN - 1460-2199 UR - https://www.unboundmedicine.com/medline/citation/31318013/Auditory-Articulatory_Neural_Alignment_between_Listener_and_Speaker_during_Verbal_Communication L2 - https://academic.oup.com/cercor/article-lookup/doi/10.1093/cercor/bhz138 DB - PRIME DP - Unbound Medicine ER -