Tags

Type your tag names separated by a space and hit enter

Rising tones and rustling noises: Metaphors in gestural depictions of sounds.
PLoS One. 2017; 12(7):e0181786.Plos

Abstract

Communicating an auditory experience with words is a difficult task and, in consequence, people often rely on imitative non-verbal vocalizations and gestures. This work explored the combination of such vocalizations and gestures to communicate auditory sensations and representations elicited by non-vocal everyday sounds. Whereas our previous studies have analyzed vocal imitations, the present research focused on gestural depictions of sounds. To this end, two studies investigated the combination of gestures and non-verbal vocalizations. A first, observational study examined a set of vocal and gestural imitations of recordings of sounds representative of a typical everyday environment (ecological sounds) with manual annotations. A second, experimental study used non-ecological sounds whose parameters had been specifically designed to elicit the behaviors highlighted in the observational study, and used quantitative measures and inferential statistics. The results showed that these depicting gestures are based on systematic analogies between a referent sound, as interpreted by a receiver, and the visual aspects of the gestures: auditory-visual metaphors. The results also suggested a different role for vocalizations and gestures. Whereas the vocalizations reproduce all features of the referent sounds as faithfully as vocally possible, the gestures focus on one salient feature with metaphors based on auditory-visual correspondences. Both studies highlighted two metaphors consistently shared across participants: the spatial metaphor of pitch (mapping different pitches to different positions on the vertical dimension), and the rustling metaphor of random fluctuations (rapidly shaking of hands and fingers). We interpret these metaphors as the result of two kinds of representations elicited by sounds: auditory sensations (pitch and loudness) mapped to spatial position, and causal representations of the sound sources (e.g. rain drops, rustling leaves) pantomimed and embodied by the participants' gestures.

Authors+Show Affiliations

Equipe Perception et Design Sonores, STMS-IRCAM-CNRS-UPMC, Institut de Recherche et de Coordination Acoustique Musique, Paris, France.Equipe Perception et Design Sonores, STMS-IRCAM-CNRS-UPMC, Institut de Recherche et de Coordination Acoustique Musique, Paris, France. Equipe Interaction Sons Musique Mouvement, STMS-IRCAM-CNRS-UPMC, Institut de Recherche et de Coordination Acoustique Musique, Paris, France.Equipe Interaction Sons Musique Mouvement, STMS-IRCAM-CNRS-UPMC, Institut de Recherche et de Coordination Acoustique Musique, Paris, France.Equipe Interaction Sons Musique Mouvement, STMS-IRCAM-CNRS-UPMC, Institut de Recherche et de Coordination Acoustique Musique, Paris, France.Equipe Perception et Design Sonores, STMS-IRCAM-CNRS-UPMC, Institut de Recherche et de Coordination Acoustique Musique, Paris, France.Equipe Perception et Design Sonores, STMS-IRCAM-CNRS-UPMC, Institut de Recherche et de Coordination Acoustique Musique, Paris, France.

Pub Type(s)

Journal Article
Observational Study

Language

eng

PubMed ID

28750071

Citation

Lemaitre, Guillaume, et al. "Rising Tones and Rustling Noises: Metaphors in Gestural Depictions of Sounds." PloS One, vol. 12, no. 7, 2017, pp. e0181786.
Lemaitre G, Scurto H, Françoise J, et al. Rising tones and rustling noises: Metaphors in gestural depictions of sounds. PLoS ONE. 2017;12(7):e0181786.
Lemaitre, G., Scurto, H., Françoise, J., Bevilacqua, F., Houix, O., & Susini, P. (2017). Rising tones and rustling noises: Metaphors in gestural depictions of sounds. PloS One, 12(7), e0181786. https://doi.org/10.1371/journal.pone.0181786
Lemaitre G, et al. Rising Tones and Rustling Noises: Metaphors in Gestural Depictions of Sounds. PLoS ONE. 2017;12(7):e0181786. PubMed PMID: 28750071.
* Article titles in AMA citation format should be in sentence-case
TY - JOUR T1 - Rising tones and rustling noises: Metaphors in gestural depictions of sounds. AU - Lemaitre,Guillaume, AU - Scurto,Hugo, AU - Françoise,Jules, AU - Bevilacqua,Frédéric, AU - Houix,Olivier, AU - Susini,Patrick, Y1 - 2017/07/27/ PY - 2017/04/27/received PY - 2017/07/06/accepted PY - 2017/7/28/entrez PY - 2017/7/28/pubmed PY - 2017/10/11/medline SP - e0181786 EP - e0181786 JF - PloS one JO - PLoS ONE VL - 12 IS - 7 N2 - Communicating an auditory experience with words is a difficult task and, in consequence, people often rely on imitative non-verbal vocalizations and gestures. This work explored the combination of such vocalizations and gestures to communicate auditory sensations and representations elicited by non-vocal everyday sounds. Whereas our previous studies have analyzed vocal imitations, the present research focused on gestural depictions of sounds. To this end, two studies investigated the combination of gestures and non-verbal vocalizations. A first, observational study examined a set of vocal and gestural imitations of recordings of sounds representative of a typical everyday environment (ecological sounds) with manual annotations. A second, experimental study used non-ecological sounds whose parameters had been specifically designed to elicit the behaviors highlighted in the observational study, and used quantitative measures and inferential statistics. The results showed that these depicting gestures are based on systematic analogies between a referent sound, as interpreted by a receiver, and the visual aspects of the gestures: auditory-visual metaphors. The results also suggested a different role for vocalizations and gestures. Whereas the vocalizations reproduce all features of the referent sounds as faithfully as vocally possible, the gestures focus on one salient feature with metaphors based on auditory-visual correspondences. Both studies highlighted two metaphors consistently shared across participants: the spatial metaphor of pitch (mapping different pitches to different positions on the vertical dimension), and the rustling metaphor of random fluctuations (rapidly shaking of hands and fingers). We interpret these metaphors as the result of two kinds of representations elicited by sounds: auditory sensations (pitch and loudness) mapped to spatial position, and causal representations of the sound sources (e.g. rain drops, rustling leaves) pantomimed and embodied by the participants' gestures. SN - 1932-6203 UR - https://www.unboundmedicine.com/medline/citation/28750071/Rising_tones_and_rustling_noises:_Metaphors_in_gestural_depictions_of_sounds_ L2 - http://dx.plos.org/10.1371/journal.pone.0181786 DB - PRIME DP - Unbound Medicine ER -