Beat gestures and syntactic parsing: an ERP study

We tested the prosodic hypothesis that the temporal alignment of a speaker's beat gestures in a sentence influences syntactic parsing by driving the listener's attention. Participants chose between two possible interpretations of relative-clause (RC) ambiguous sentences, while thei...

Descripción completa

Detalles Bibliográficos
Autores: Biau, Emmanuel, 1985-, Fromont, Lauren A., Soto-Faraco, Salvador, 1970-
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2017
País:España
Institución:Universitat Pompeu Fabra
Repositorio:Repositorio Digital de la UPF
OAI Identifier:oai:repositori.upf.edu:10230/47864
Acceso en línea:http://hdl.handle.net/10230/47864
http://dx.doi.org/10.1111/lang.12257
Access Level:acceso abierto
Palabra clave:Audiovisual speech
Gestures
Prosody
Syntactic parsing
ERPs
P600
id ES_bfb72dc325d2a7cf58197ca8f381b050
oai_identifier_str oai:repositori.upf.edu:10230/47864
network_acronym_str ES
network_name_str España
repository_id_str
spelling Beat gestures and syntactic parsing: an ERP studyBiau, Emmanuel, 1985-Fromont, Lauren A.Soto-Faraco, Salvador, 1970-Audiovisual speechGesturesProsodySyntactic parsingERPsP600We tested the prosodic hypothesis that the temporal alignment of a speaker's beat gestures in a sentence influences syntactic parsing by driving the listener's attention. Participants chose between two possible interpretations of relative-clause (RC) ambiguous sentences, while their electroencephalogram (EEG) was recorded. We manipulated the alignment of the beat within sentences where auditory prosody was removed. Behavioral performance showed no effect of beat placement on the sentences’ interpretation, while event-related potentials (ERPs) revealed a positive shift of the signal in the windows corresponding to N100 and P200 components. Additionally, post hoc analyses of the ERPs time locked to the RC revealed a modulation of the P600 component as a function of gesture. These results suggest that beats modulate early processing of affiliate words in continuous speech and potentially have a global impact at the level of sentence-parsing components. We speculate that beats must be synergistic with auditory prosody to be fully consequential in behavior.This research was supported by the Ministerio de Econom´ıa y Competitividad (PSI2016-75558-P), AGAUR Generalitat de Catalunya (2014SGR856), and the European Research Council (StG-2010 263145). EB was supported by a postdoctoral fellowship from the European Union’s Horizon 2020 research and innovation programme, under the Marie Sklodowska-Curie grant agreement No. 707727Wiley202120212017info:eu-repo/semantics/articleinfo:eu-repo/semantics/acceptedVersionapplication/pdfapplication/pdfhttp://hdl.handle.net/10230/47864http://dx.doi.org/10.1111/lang.12257reponame:Repositorio Digital de la UPFinstname:Universitat Pompeu FabraInglésLanguage Learning. 2017;68(S1):102-26info:eu-repo/grantAgreement/EC/H2020/707727info:eu-repo/grantAgreement/ES/1PE/PSI2016-75558-Pinfo:eu-repo/grantAgreement/EC/FP7/263145This is the peer reviewed version of the following article: Biau E, Fromont LA, Soto Faraco S. Beat gestures and syntactic parsing: an ERP study. Lang Learn. 2017;68(S1):102-26, which has been published in final form at http://dx.doi.org/10.1111/lang.12257. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Use of Self-Archived Versions.info:eu-repo/semantics/openAccessoai:repositori.upf.edu:10230/478642026-06-12T07:21:37Z
dc.title.none.fl_str_mv Beat gestures and syntactic parsing: an ERP study
title Beat gestures and syntactic parsing: an ERP study
spellingShingle Beat gestures and syntactic parsing: an ERP study
Biau, Emmanuel, 1985-
Audiovisual speech
Gestures
Prosody
Syntactic parsing
ERPs
P600
title_short Beat gestures and syntactic parsing: an ERP study
title_full Beat gestures and syntactic parsing: an ERP study
title_fullStr Beat gestures and syntactic parsing: an ERP study
title_full_unstemmed Beat gestures and syntactic parsing: an ERP study
title_sort Beat gestures and syntactic parsing: an ERP study
dc.creator.none.fl_str_mv Biau, Emmanuel, 1985-
Fromont, Lauren A.
Soto-Faraco, Salvador, 1970-
author Biau, Emmanuel, 1985-
author_facet Biau, Emmanuel, 1985-
Fromont, Lauren A.
Soto-Faraco, Salvador, 1970-
author_role author
author2 Fromont, Lauren A.
Soto-Faraco, Salvador, 1970-
author2_role author
author
dc.subject.none.fl_str_mv Audiovisual speech
Gestures
Prosody
Syntactic parsing
ERPs
P600
topic Audiovisual speech
Gestures
Prosody
Syntactic parsing
ERPs
P600
description We tested the prosodic hypothesis that the temporal alignment of a speaker's beat gestures in a sentence influences syntactic parsing by driving the listener's attention. Participants chose between two possible interpretations of relative-clause (RC) ambiguous sentences, while their electroencephalogram (EEG) was recorded. We manipulated the alignment of the beat within sentences where auditory prosody was removed. Behavioral performance showed no effect of beat placement on the sentences’ interpretation, while event-related potentials (ERPs) revealed a positive shift of the signal in the windows corresponding to N100 and P200 components. Additionally, post hoc analyses of the ERPs time locked to the RC revealed a modulation of the P600 component as a function of gesture. These results suggest that beats modulate early processing of affiliate words in continuous speech and potentially have a global impact at the level of sentence-parsing components. We speculate that beats must be synergistic with auditory prosody to be fully consequential in behavior.
publishDate 2017
dc.date.none.fl_str_mv 2017
2021
2021
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/acceptedVersion
format article
status_str acceptedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/47864
http://dx.doi.org/10.1111/lang.12257
url http://hdl.handle.net/10230/47864
http://dx.doi.org/10.1111/lang.12257
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Language Learning. 2017;68(S1):102-26
info:eu-repo/grantAgreement/EC/H2020/707727
info:eu-repo/grantAgreement/ES/1PE/PSI2016-75558-P
info:eu-repo/grantAgreement/EC/FP7/263145
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Wiley
publisher.none.fl_str_mv Wiley
dc.source.none.fl_str_mv reponame:Repositorio Digital de la UPF
instname:Universitat Pompeu Fabra
instname_str Universitat Pompeu Fabra
reponame_str Repositorio Digital de la UPF
collection Repositorio Digital de la UPF
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869418415784984576
score 15,811543

Similares en LA Referencia