Synchronization by the hand: the sight of gestures modulates low-frequency activity in brain responses to continuous speech

During social interactions, speakers often produce spontaneous gestures to accompany their speech. These coordinated body movements convey communicative intentions, and modulate how listeners perceive the message in a subtle, but important way. In the present perspective, we put the focus on the rol...

Full description

Bibliographic Details
Authors: Biau, Emmanuel, 1985-, Soto-Faraco, Salvador, 1970-
Format: article
Status:Published version
Publication Date:2015
Country:España
Institution:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repository:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10230/25186
Online Access:http://hdl.handle.net/10230/25186
http://dx.doi.org/10.3389/fnhum.2015.00527
Access Level:Open access
Keyword:Audiovisual speech
Gestures
Beats
Low-frequency oscillations
EEG
Description
Summary:During social interactions, speakers often produce spontaneous gestures to accompany their speech. These coordinated body movements convey communicative intentions, and modulate how listeners perceive the message in a subtle, but important way. In the present perspective, we put the focus on the role that congruent non-verbal information from beat gestures may play in the neural responses to speech. Whilst delta-theta oscillatory brain responses reflect the time-frequency structure of the speech signal, we argue that beat gestures promote phase resetting at relevant word onsets. This mechanism may facilitate the anticipation of associated acoustic cues relevant for prosodic/syllabic-based segmentation in speech perception. We report recently published data supporting this hypothesis, and discuss the potential of beats (and gestures in general) for further studies investigating continuous AV speech processing through low-frequency oscillations.