Dependence of exponents on text length versus finite-size scaling for word-frequency distributions

Some authors have recently argued that a finite-size scaling law for the text-length dependence of word-frequency distributions cannot be conceptually valid. Here we give solid quantitative evidence for the validity of this scaling law, using both careful statistical tests and analytical arguments b...

ver descrição completa

Detalhes bibliográficos
Autores: Corral, A., Font-Clos, F.
Formato: artículo
Estado:Versión publicada
Fecha de publicación:2017
País:España
Recursos:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:2072/377767
Acesso em linha:http://hdl.handle.net/2072/377767
Access Level:acceso abierto
Palavra-chave:Matemàtiques
51
id ES_52e9bb9d2e6c8d4bd2645c9a021b1c2e
oai_identifier_str oai:recercat.cat:2072/377767
network_acronym_str ES
network_name_str España
repository_id_str
spelling Dependence of exponents on text length versus finite-size scaling for word-frequency distributionsCorral, A.Font-Clos, F.Matemàtiques51Some authors have recently argued that a finite-size scaling law for the text-length dependence of word-frequency distributions cannot be conceptually valid. Here we give solid quantitative evidence for the validity of this scaling law, using both careful statistical tests and analytical arguments based on the generalized central-limit theorem applied to the moments of the distribution (and obtaining a novel derivation of Heaps'\'' law as a by-product). We also find that the picture of word-frequency distributions with power-law exponents that decrease with text length [X. Yan and P. Minnhagen, Physica A 444, 828 (2016)] does not stand with rigorous statistical analysis. Instead, we show that the distributions are perfectly described by power-law tails with stable exponents, whose values are close to 2, in agreement with the classical Zipf'\''s law. Some misconceptions about scaling are also clarified.2017info:eu-repo/semantics/articleinfo:eu-repo/semantics/publishedVersion9 p.application/pdfhttp://hdl.handle.net/2072/377767RECERCAT (Dipòsit de la Recerca de Catalunya)reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésPhysical Review EL'accés als continguts d'aquest document queda condicionat a l'acceptació de les condicions d'ús establertes per la següent llicència Creative Commons:http://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessoai:recercat.cat:2072/3777672026-05-29T05:05:01Z
dc.title.none.fl_str_mv Dependence of exponents on text length versus finite-size scaling for word-frequency distributions
title Dependence of exponents on text length versus finite-size scaling for word-frequency distributions
spellingShingle Dependence of exponents on text length versus finite-size scaling for word-frequency distributions
Corral, A.
Matemàtiques
51
title_short Dependence of exponents on text length versus finite-size scaling for word-frequency distributions
title_full Dependence of exponents on text length versus finite-size scaling for word-frequency distributions
title_fullStr Dependence of exponents on text length versus finite-size scaling for word-frequency distributions
title_full_unstemmed Dependence of exponents on text length versus finite-size scaling for word-frequency distributions
title_sort Dependence of exponents on text length versus finite-size scaling for word-frequency distributions
dc.creator.none.fl_str_mv Corral, A.
Font-Clos, F.
author Corral, A.
author_facet Corral, A.
Font-Clos, F.
author_role author
author2 Font-Clos, F.
author2_role author
dc.subject.none.fl_str_mv Matemàtiques
51
topic Matemàtiques
51
description Some authors have recently argued that a finite-size scaling law for the text-length dependence of word-frequency distributions cannot be conceptually valid. Here we give solid quantitative evidence for the validity of this scaling law, using both careful statistical tests and analytical arguments based on the generalized central-limit theorem applied to the moments of the distribution (and obtaining a novel derivation of Heaps'\'' law as a by-product). We also find that the picture of word-frequency distributions with power-law exponents that decrease with text length [X. Yan and P. Minnhagen, Physica A 444, 828 (2016)] does not stand with rigorous statistical analysis. Instead, we show that the distributions are perfectly described by power-law tails with stable exponents, whose values are close to 2, in agreement with the classical Zipf'\''s law. Some misconceptions about scaling are also clarified.
publishDate 2017
dc.date.none.fl_str_mv 2017
dc.type.none.fl_str_mv info:eu-repo/semantics/article
info:eu-repo/semantics/publishedVersion
format article
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/2072/377767
url http://hdl.handle.net/2072/377767
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.relation.none.fl_str_mv Physical Review E
dc.rights.none.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 9 p.
application/pdf
dc.source.none.fl_str_mv RECERCAT (Dipòsit de la Recerca de Catalunya)
reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869408081382735872
score 15.81155

Registos relacionados