Beat gestures modulate auditory integration in speech perception

Spontaneous beat gestures are an integral part of the paralinguistic context during face-to-face conversations. Here we investigated the time course of beat-speech integration in speech perception by measuring ERPs evoked by words pronounced with or without an accompanying beat gesture, while partic...

ver descrição completa

Detalhes bibliográficos
Autores: Biau, Emmanuel, 1985-, Soto-Faraco, Salvador, 1970-
Formato: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2013
País:España
Recursos:Universitat Pompeu Fabra
Repositorio:Repositorio Digital de la UPF
OAI Identifier:oai:repositori.upf.edu:10230/24975
Acesso em linha:http://hdl.handle.net/10230/24975
http://dx.doi.org/10.1016/j.bandl.2012.10.008
Access Level:acceso abierto
Palavra-chave:Speech processing
Gestures
Audiovisual integration
ERPs
Descrição
Resumo:Spontaneous beat gestures are an integral part of the paralinguistic context during face-to-face conversations. Here we investigated the time course of beat-speech integration in speech perception by measuring ERPs evoked by words pronounced with or without an accompanying beat gesture, while participants watched a spoken discourse. Words accompanied by beats elicited a positive shift in ERPs at an early sensory stage (before 100 ms) and at a later time window coinciding with the auditory component P2. The same word tokens produced no ERP differences when participants listened to the discourse without view of the speaker. We conclude that beat gestures are integrated with speech early on in time and modulate sensory/phonological levels of processing. The present results support the possible role of beats as a highlighter, helping the listener to direct the focus of attention to important information and modulate the parsing of the speech stream.