The Information structure–prosody interface in text-to-speech technologies: an empirical perspective

The correspondence between the communicative intention of a speaker in terms of Information Structure and the way this speaker reflects communicative aspects by means of prosody have been a fruitful field of study in Linguistics. However, text-to-speech applications still lack the variability and ri...

Descripción completa

Detalles Bibliográficos
Autores: Domínguez Bajo, Mónica, Farrús, Mireia, Wanner, Leo
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2021
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10230/47009
Acceso en línea:http://hdl.handle.net/10230/47009
http://dx.doi.org/10.1515/cllt-2020-0008
Access Level:acceso abierto
Palabra clave:Communicative structure
Information structure
Intonation
Prosody
Rheme
Specifier
Thematicity
Theme
ToBI
id ES_8a8a2367fce57ad411cba2d1c60aa4ca
oai_identifier_str oai:recercat.cat:10230/47009
network_acronym_str ES
network_name_str España
repository_id_str
spelling The Information structure–prosody interface in text-to-speech technologies: an empirical perspectiveDomínguez Bajo, MónicaFarrús, MireiaWanner, LeoCommunicative structureInformation structureIntonationProsodyRhemeSpecifierThematicityThemeToBIThe correspondence between the communicative intention of a speaker in terms of Information Structure and the way this speaker reflects communicative aspects by means of prosody have been a fruitful field of study in Linguistics. However, text-to-speech applications still lack the variability and richness found in human speech in terms of how humans display their communication skills. Some attempts were made in the past to model one aspect of Information Structure, namely thematicity for its application to intonation generation in text-to-speech technologies. Yet these applications suffer from two limitations: (i) they draw upon a small number of made-up simple question-answer pairs rather than on real (spoken or written) corpus material; and (ii) they do not explore whether any other interpretation would better suit a wider range of textual genres beyond dialogues. In this paper, two different interpretations of thematicity in the field of speech technologies are examined: the state-of-art binary (and flat) theme-rheme, and the hierarchical thematicity defined by Igor Mel’ˇcuk within the Meaning-Text Theory. The outcome of the experiments on a corpus of native speakers of US English suggests that the latter interpretation of thematicity has a versatile implementation potential for text-to-speech applications of the Information Structure-–prosody interfaceThis work has been partially funded by the European Commission in the context of its H2020 Programme under the contract numbers H2020-645012-RIA (KRISTINA) and H2020-870930-IA (WELCOME). The second author has been funded by the Agencia Estatal de Investigaci´on (AEI), Ministerio de Ciencia, Innovaci´on y Universidades and the Fondo Social Europeo (FSE), grant RYC2015-17239 (AEI/FSE, UE).De Gruyter20212021info:eu-repo/semantics/articleinfo:eu-repo/semantics/acceptedVersionapplication/pdfapplication/pdfhttp://hdl.handle.net/10230/47009http://dx.doi.org/10.1515/cllt-2020-0008reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésCorpus Linguistics and Linguistic Theory. 2021info:eu-repo/grantAgreement/EC/H2020/645012info:eu-repo/grantAgreement/EC/H2020/870930info:eu-repo/grantAgreement/ES/1PE/RYC2015-17239© De Gruyter Published version available at https://www.degruyter.com/document/doi/10.1515/cllt-2020-0008 http://dx.doi.org/10.1515/cllt-2020-0008info:eu-repo/semantics/openAccessoai:recercat.cat:10230/470092026-05-29T05:05:01Z
dc.title.none.fl_str_mv The Information structure–prosody interface in text-to-speech technologies: an empirical perspective
title The Information structure–prosody interface in text-to-speech technologies: an empirical perspective
spellingShingle The Information structure–prosody interface in text-to-speech technologies: an empirical perspective
Domínguez Bajo, Mónica
Communicative structure
Information structure
Intonation
Prosody
Rheme
Specifier
Thematicity
Theme
ToBI
title_short The Information structure–prosody interface in text-to-speech technologies: an empirical perspective
title_full The Information structure–prosody interface in text-to-speech technologies: an empirical perspective
title_fullStr The Information structure–prosody interface in text-to-speech technologies: an empirical perspective
title_full_unstemmed The Information structure–prosody interface in text-to-speech technologies: an empirical perspective
title_sort The Information structure–prosody interface in text-to-speech technologies: an empirical perspective
dc.creator.none.fl_str_mv Domínguez Bajo, Mónica
Farrús, Mireia
Wanner, Leo
author Domínguez Bajo, Mónica
author_facet Domínguez Bajo, Mónica
Farrús, Mireia
Wanner, Leo
author_role author
author2 Farrús, Mireia
Wanner, Leo
author2_role author
author
dc.subject.none.fl_str_mv Communicative structure
Information structure
Intonation
Prosody
Rheme
Specifier
Thematicity
Theme
ToBI
topic Communicative structure
Information structure
Intonation
Prosody
Rheme
Specifier
Thematicity
Theme
ToBI
description The correspondence between the communicative intention of a speaker in terms of Information Structure and the way this speaker reflects communicative aspects by means of prosody have been a fruitful field of study in Linguistics. However, text-to-speech applications still lack the variability and richness found in human speech in terms of how humans display their communication skills. Some attempts were made in the past to model one aspect of Information Structure, namely thematicity for its application to intonation generation in text-to-speech technologies. Yet these applications suffer from two limitations: (i) they draw upon a small number of made-up simple question-answer pairs rather than on real (spoken or written) corpus material; and (ii) they do not explore whether any other interpretation would better suit a wider range of textual genres beyond dialogues. In this paper, two different interpretations of thematicity in the field of speech technologies are examined: the state-of-art binary (and flat) theme-rheme, and the hierarchical thematicity defined by Igor Mel’ˇcuk within the Meaning-Text Theory. The outcome of the experiments on a corpus of native speakers of US English suggests that the latter interpretation of thematicity has a versatile implementation potential for text-to-speech applications of the Information Structure-–prosody interface
publishDate 2021
dc.date.none.fl_str_mv 2021
2021
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/acceptedVersion
format article
status_str acceptedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/47009
http://dx.doi.org/10.1515/cllt-2020-0008
url http://hdl.handle.net/10230/47009
http://dx.doi.org/10.1515/cllt-2020-0008
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Corpus Linguistics and Linguistic Theory. 2021
info:eu-repo/grantAgreement/EC/H2020/645012
info:eu-repo/grantAgreement/EC/H2020/870930
info:eu-repo/grantAgreement/ES/1PE/RYC2015-17239
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv De Gruyter
publisher.none.fl_str_mv De Gruyter
dc.source.none.fl_str_mv reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869412724246577152
score 15,812429