Audiovisual integration as conflict resolution: The conflict of the McGurk illusion

There are two main behavioral expressions of multisensory integration (MSI) in speech; the perceptual enhancement produced by the sight of the congruent lip movements of the speaker, and the illusory sound perceived when a speech syllable is dubbed with incongruent lip movements, in the McGurk effec...

Descripción completa

Detalles Bibliográficos
Autores: Morís Fernández, Luis, 1982-, Macaluso, Emiliano, Soto-Faraco, Salvador, 1970-
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2017
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10230/34546
Acceso en línea:http://hdl.handle.net/10230/34546
http://dx.doi.org/10.1002/hbm.23758
Access Level:acceso abierto
Palabra clave:Speech perception
Audiovisual speech
Multisensory integration
Illusion
McGurk illusion
Gyrus cinguli
Prefrontal cortex
Magnetic resonance imaging
id ES_20248f29fe2ffc4b99c77c28fa6af5c8
oai_identifier_str oai:recercat.cat:10230/34546
network_acronym_str ES
network_name_str España
repository_id_str
spelling Audiovisual integration as conflict resolution: The conflict of the McGurk illusionMorís Fernández, Luis, 1982-Macaluso, EmilianoSoto-Faraco, Salvador, 1970-Speech perceptionAudiovisual speechMultisensory integrationIllusionMcGurk illusionGyrus cinguliPrefrontal cortexMagnetic resonance imagingThere are two main behavioral expressions of multisensory integration (MSI) in speech; the perceptual enhancement produced by the sight of the congruent lip movements of the speaker, and the illusory sound perceived when a speech syllable is dubbed with incongruent lip movements, in the McGurk effect. These two models have been used very often to study MSI. Here, we contend that, unlike congruent audiovisually (AV) speech, the McGurk effect involves brain areas related to conflict detection and resolution. To test this hypothesis, we used fMRI to measure blood oxygen level dependent responses to AV speech syllables. We analyzed brain activity as a function of the nature of the stimuli—McGurk or non‐McGurk—and the perceptual outcome regarding MSI—integrated or not integrated response—in a 2 × 2 factorial design. The results showed that, regardless of perceptual outcome, AV mismatch activated general‐purpose conflict areas (e.g., anterior cingulate cortex) as well as specific AV speech conflict areas (e.g., inferior frontal gyrus), compared with AV matching stimuli. Moreover, these conflict areas showed stronger activation on trials where the McGurk illusion was perceived compared with non‐illusory trials, despite the stimuli where physically identical. We conclude that the AV incongruence in McGurk stimuli triggers the activation of conflict processing areas and that the process of resolving the cross‐modal conflict is critical for the McGurk illusion to arise. Hum Brain Mapp 38:5691–5705, 2017.This research was supported by the Ministerio de Economía y Competitividad (PSI2016–75558‐PAEI/FEDER), AGAUR Generalitat de Catalunya (2014SGR856 and 2012BE100392), and the European Research Council (StG‐2010 263145). The Neuroimaging Laboratory of the Fondazione Santa Lucia is supported by the Italian Ministry of Health. EM is supported by the program “Investissements d'Avenir” (ANR‐11‐IDEX‐0007) and by the program “BQR Accueil EC 16” of University Claude Bernard Lyon 1.Wiley20182017info:eu-repo/semantics/articleinfo:eu-repo/semantics/acceptedVersionapplication/pdfapplication/vnd.openxmlformats-officedocument.wordprocessingml.documenthttp://hdl.handle.net/10230/34546http://dx.doi.org/10.1002/hbm.23758reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésHuman Brain Mapping. 2017 Nov;38(11):5691-705.info:eu-repo/grantAgreement/ES/1PE/PSI2016‐75558‐P AEIinfo:eu-repo/grantAgreement/EC/FP7/263145This is the peer reviewed version of the following article: Morís Fernández L, Macaluso E, Soto‐Faraco S. Audiovisual integration as conflict resolution: The conflict of the McGurk illusion. Hum Brain Mapp. 2017 Nov;38(11):5691-705, which has been published in final form at http://dx.doi.org/10.1002/hbm.23758. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.info:eu-repo/semantics/openAccessoai:recercat.cat:10230/345462026-05-29T05:05:01Z
dc.title.none.fl_str_mv Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
title Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
spellingShingle Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
Morís Fernández, Luis, 1982-
Speech perception
Audiovisual speech
Multisensory integration
Illusion
McGurk illusion
Gyrus cinguli
Prefrontal cortex
Magnetic resonance imaging
title_short Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
title_full Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
title_fullStr Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
title_full_unstemmed Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
title_sort Audiovisual integration as conflict resolution: The conflict of the McGurk illusion
dc.creator.none.fl_str_mv Morís Fernández, Luis, 1982-
Macaluso, Emiliano
Soto-Faraco, Salvador, 1970-
author Morís Fernández, Luis, 1982-
author_facet Morís Fernández, Luis, 1982-
Macaluso, Emiliano
Soto-Faraco, Salvador, 1970-
author_role author
author2 Macaluso, Emiliano
Soto-Faraco, Salvador, 1970-
author2_role author
author
dc.subject.none.fl_str_mv Speech perception
Audiovisual speech
Multisensory integration
Illusion
McGurk illusion
Gyrus cinguli
Prefrontal cortex
Magnetic resonance imaging
topic Speech perception
Audiovisual speech
Multisensory integration
Illusion
McGurk illusion
Gyrus cinguli
Prefrontal cortex
Magnetic resonance imaging
description There are two main behavioral expressions of multisensory integration (MSI) in speech; the perceptual enhancement produced by the sight of the congruent lip movements of the speaker, and the illusory sound perceived when a speech syllable is dubbed with incongruent lip movements, in the McGurk effect. These two models have been used very often to study MSI. Here, we contend that, unlike congruent audiovisually (AV) speech, the McGurk effect involves brain areas related to conflict detection and resolution. To test this hypothesis, we used fMRI to measure blood oxygen level dependent responses to AV speech syllables. We analyzed brain activity as a function of the nature of the stimuli—McGurk or non‐McGurk—and the perceptual outcome regarding MSI—integrated or not integrated response—in a 2 × 2 factorial design. The results showed that, regardless of perceptual outcome, AV mismatch activated general‐purpose conflict areas (e.g., anterior cingulate cortex) as well as specific AV speech conflict areas (e.g., inferior frontal gyrus), compared with AV matching stimuli. Moreover, these conflict areas showed stronger activation on trials where the McGurk illusion was perceived compared with non‐illusory trials, despite the stimuli where physically identical. We conclude that the AV incongruence in McGurk stimuli triggers the activation of conflict processing areas and that the process of resolving the cross‐modal conflict is critical for the McGurk illusion to arise. Hum Brain Mapp 38:5691–5705, 2017.
publishDate 2017
dc.date.none.fl_str_mv 2017
2018
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/acceptedVersion
format article
status_str acceptedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/34546
http://dx.doi.org/10.1002/hbm.23758
url http://hdl.handle.net/10230/34546
http://dx.doi.org/10.1002/hbm.23758
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Human Brain Mapping. 2017 Nov;38(11):5691-705.
info:eu-repo/grantAgreement/ES/1PE/PSI2016‐75558‐P AEI
info:eu-repo/grantAgreement/EC/FP7/263145
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/vnd.openxmlformats-officedocument.wordprocessingml.document
dc.publisher.none.fl_str_mv Wiley
publisher.none.fl_str_mv Wiley
dc.source.none.fl_str_mv reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869404441905463296
score 15,811543

Similares en LA Referencia