Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC

ABSTRACT: Research on prominence perception has made use of animated agents and controlled speech in experimental settings, but these methodologies have disregarded some aspects of the acoustic and visual correlates of prominence. To overcome these limitations we propose a new methodological approac...

Descripción completa

Detalles Bibliográficos
Autores: Jiménez-Bravo Bonilla, Miguel, Marrero Aguiar, Victoria
Tipo de recurso: artículo
Fecha de publicación:2020
País:España
Institución:Universidad Complutense de Madrid (UCM)
Repositorio:Docta Complutense
Idioma:inglés
OAI Identifier:oai:docta.ucm.es:20.500.14352/115877
Acceso en línea:https://hdl.handle.net/20.500.14352/115877
Access Level:acceso abierto
Palabra clave:808.5
Audiovisual prosody
Gesture
Prominence
Speech perception
Spontaneous speech
Generalised linear mixed models
Akaike Information Criterion
Lingüística
57 Lingüística
id ES_5ffd7ee348a2adf18c7a893a4699f751
oai_identifier_str oai:docta.ucm.es:20.500.14352/115877
network_acronym_str ES
network_name_str España
repository_id_str
spelling Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AICJiménez-Bravo Bonilla, MiguelMarrero Aguiar, Victoria808.5Audiovisual prosodyGestureProminenceSpeech perceptionSpontaneous speechGeneralised linear mixed modelsAkaike Information CriterionLingüística57 LingüísticaABSTRACT: Research on prominence perception has made use of animated agents and controlled speech in experimental settings, but these methodologies have disregarded some aspects of the acoustic and visual correlates of prominence. To overcome these limitations we propose a new methodological approach using spontaneous speech data. For this, we created a small database with extracts from a television talent show and neutralised the prominence-lending properties of the acoustic cues of prominence in the speech signal. In our pilot study twelve naïve listeners marked words for binary prominence (prominent vs. non-prominent) in two modalities, i.e. audio-only and audiovisual, under three conditions involving neutralisation of (a) fundamental frequency, (b) intensity, and (c) both fundamental frequency and intensity. Additionally, the marks of two trained listeners served as control condition. Different generalised linear mixed models were estimated and compared using the Akaike Information Criterion (AIC). The most parsimonious model was then examined using traditional null-hypothesis testing in order to provisionally establish the effects of our independent variables on prominence marking. We argue that spontaneous speech can be successfully applied to the study of the multimodal perception of prominence.ElsevierUniversidad Complutense de Madrid20202020-11-0120202020-11-01journal articlehttp://purl.org/coar/resource_type/c_6501AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/20.500.14352/115877reponame:Docta Complutenseinstname:Universidad Complutense de Madrid (UCM)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:docta.ucm.es:20.500.14352/1158772026-06-02T12:44:21Z
dc.title.none.fl_str_mv Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC
title Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC
spellingShingle Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC
Jiménez-Bravo Bonilla, Miguel
808.5
Audiovisual prosody
Gesture
Prominence
Speech perception
Spontaneous speech
Generalised linear mixed models
Akaike Information Criterion
Lingüística
57 Lingüística
title_short Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC
title_full Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC
title_fullStr Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC
title_full_unstemmed Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC
title_sort Multimodal perception of prominence in spontaneous speech : a methodological proposal using mixed models and AIC
dc.creator.none.fl_str_mv Jiménez-Bravo Bonilla, Miguel
Marrero Aguiar, Victoria
author Jiménez-Bravo Bonilla, Miguel
author_facet Jiménez-Bravo Bonilla, Miguel
Marrero Aguiar, Victoria
author_role author
author2 Marrero Aguiar, Victoria
author2_role author
dc.contributor.none.fl_str_mv Universidad Complutense de Madrid
dc.subject.none.fl_str_mv 808.5
Audiovisual prosody
Gesture
Prominence
Speech perception
Spontaneous speech
Generalised linear mixed models
Akaike Information Criterion
Lingüística
57 Lingüística
topic 808.5
Audiovisual prosody
Gesture
Prominence
Speech perception
Spontaneous speech
Generalised linear mixed models
Akaike Information Criterion
Lingüística
57 Lingüística
description ABSTRACT: Research on prominence perception has made use of animated agents and controlled speech in experimental settings, but these methodologies have disregarded some aspects of the acoustic and visual correlates of prominence. To overcome these limitations we propose a new methodological approach using spontaneous speech data. For this, we created a small database with extracts from a television talent show and neutralised the prominence-lending properties of the acoustic cues of prominence in the speech signal. In our pilot study twelve naïve listeners marked words for binary prominence (prominent vs. non-prominent) in two modalities, i.e. audio-only and audiovisual, under three conditions involving neutralisation of (a) fundamental frequency, (b) intensity, and (c) both fundamental frequency and intensity. Additionally, the marks of two trained listeners served as control condition. Different generalised linear mixed models were estimated and compared using the Akaike Information Criterion (AIC). The most parsimonious model was then examined using traditional null-hypothesis testing in order to provisionally establish the effects of our independent variables on prominence marking. We argue that spontaneous speech can be successfully applied to the study of the multimodal perception of prominence.
publishDate 2020
dc.date.none.fl_str_mv 2020
2020-11-01
2020
2020-11-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
AM
http://purl.org/coar/version/c_ab4af688f83e57aa
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/20.500.14352/115877
url https://hdl.handle.net/20.500.14352/115877
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:Docta Complutense
instname:Universidad Complutense de Madrid (UCM)
instname_str Universidad Complutense de Madrid (UCM)
reponame_str Docta Complutense
collection Docta Complutense
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869409259533369344
score 15,811543

Similares en LA Referencia