Speech segmentation is facilitated by visual cues

Evidence from infant studies indicates that language learning can be facilitated by multimodal cues. We extended this observation to adult language learning by studying the effects of simultaneous visual cues (nonassociated object images) on speech segmentation performance. Our results indicate that...

Descripción completa

Detalles Bibliográficos
Autores: Cunillera, Toni, Camara Mancha, Estela, Laine, Matti, Rodríguez Fornells, Antoni
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2010
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:2445/136600
Acceso en línea:https://hdl.handle.net/2445/136600
Access Level:acceso abierto
Palabra clave:Adquisició del llenguatge
Percepció del llenguatge
Language acquisition
Speech perception
id ES_a6bfb7052032b2f8431d7ce31bccb0db
oai_identifier_str oai:recercat.cat:2445/136600
network_acronym_str ES
network_name_str España
repository_id_str
spelling Speech segmentation is facilitated by visual cuesCunillera, ToniCamara Mancha, EstelaLaine, MattiRodríguez Fornells, AntoniAdquisició del llenguatgePercepció del llenguatgeLanguage acquisitionSpeech perceptionEvidence from infant studies indicates that language learning can be facilitated by multimodal cues. We extended this observation to adult language learning by studying the effects of simultaneous visual cues (nonassociated object images) on speech segmentation performance. Our results indicate that segmentation of new words from a continuous speech stream is facilitated by simultaneous visual input that it is presented at or near syllables that exhibit the low transitional probability indicative of word boundaries. This indicates that temporal audio-visual contiguity helps in directing attention to word boundaries at the earliest stages of language learning. Off-boundary or arrhythmic picture sequences did not affect segmentation performance, suggesting that the language learning system can effectively disregard noninformative visual information. Detection of temporal contiguity between multimodal stimuli may be useful in both infants and second-language learners not only for facilitating speech segmentation, but also for detecting word-object relationships in natural environments.Taylor and Francis2019201920102019info:eu-repo/semantics/articleinfo:eu-repo/semantics/acceptedVersion32 p.application/pdfhttps://hdl.handle.net/2445/136600Articles publicats en revistes (Cognició, Desenvolupament i Psicologia de l'Educació)reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésVersió postprint del document publicat a: https://doi.org/10.1080/17470210902888809Quarterly Journal of Experimental Psychology, 2010, vol. 63, num. 2, p. 260-274https://doi.org/10.1080/17470210902888809(c) The Experimental Psychology Society, 2010info:eu-repo/semantics/openAccessoai:recercat.cat:2445/1366002026-05-29T05:05:01Z
dc.title.none.fl_str_mv Speech segmentation is facilitated by visual cues
title Speech segmentation is facilitated by visual cues
spellingShingle Speech segmentation is facilitated by visual cues
Cunillera, Toni
Adquisició del llenguatge
Percepció del llenguatge
Language acquisition
Speech perception
title_short Speech segmentation is facilitated by visual cues
title_full Speech segmentation is facilitated by visual cues
title_fullStr Speech segmentation is facilitated by visual cues
title_full_unstemmed Speech segmentation is facilitated by visual cues
title_sort Speech segmentation is facilitated by visual cues
dc.creator.none.fl_str_mv Cunillera, Toni
Camara Mancha, Estela
Laine, Matti
Rodríguez Fornells, Antoni
author Cunillera, Toni
author_facet Cunillera, Toni
Camara Mancha, Estela
Laine, Matti
Rodríguez Fornells, Antoni
author_role author
author2 Camara Mancha, Estela
Laine, Matti
Rodríguez Fornells, Antoni
author2_role author
author
author
dc.subject.none.fl_str_mv Adquisició del llenguatge
Percepció del llenguatge
Language acquisition
Speech perception
topic Adquisició del llenguatge
Percepció del llenguatge
Language acquisition
Speech perception
description Evidence from infant studies indicates that language learning can be facilitated by multimodal cues. We extended this observation to adult language learning by studying the effects of simultaneous visual cues (nonassociated object images) on speech segmentation performance. Our results indicate that segmentation of new words from a continuous speech stream is facilitated by simultaneous visual input that it is presented at or near syllables that exhibit the low transitional probability indicative of word boundaries. This indicates that temporal audio-visual contiguity helps in directing attention to word boundaries at the earliest stages of language learning. Off-boundary or arrhythmic picture sequences did not affect segmentation performance, suggesting that the language learning system can effectively disregard noninformative visual information. Detection of temporal contiguity between multimodal stimuli may be useful in both infants and second-language learners not only for facilitating speech segmentation, but also for detecting word-object relationships in natural environments.
publishDate 2010
dc.date.none.fl_str_mv 2010
2019
2019
2019
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/acceptedVersion
format article
status_str acceptedVersion
dc.identifier.none.fl_str_mv https://hdl.handle.net/2445/136600
url https://hdl.handle.net/2445/136600
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Versió postprint del document publicat a: https://doi.org/10.1080/17470210902888809
Quarterly Journal of Experimental Psychology, 2010, vol. 63, num. 2, p. 260-274
https://doi.org/10.1080/17470210902888809
dc.rights.none.fl_str_mv (c) The Experimental Psychology Society, 2010
info:eu-repo/semantics/openAccess
rights_invalid_str_mv (c) The Experimental Psychology Society, 2010
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 32 p.
application/pdf
dc.publisher.none.fl_str_mv Taylor and Francis
publisher.none.fl_str_mv Taylor and Francis
dc.source.none.fl_str_mv Articles publicats en revistes (Cognició, Desenvolupament i Psicologia de l'Educació)
reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869415723091099648
score 15,812429