Decoding least effort and scaling in signal frequency distributions

Here, assuming a general communication model where objects map to signals, a power function for the distribution of signal frequencies is derived. The model relies on the satisfaction of the receiver (hearer) communicative needs when the entropy of the number of objects per signal is maximized. Evid...

Descripción completa

Detalles Bibliográficos
Autor: Ferrer Cancho, Ramon|||0000-0002-7820-923X
Tipo de recurso: artículo
Fecha de publicación:2005
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/180172
Acceso en línea:https://hdl.handle.net/2117/180172
https://dx.doi.org/10.1016/j.physa.2004.06.158
Access Level:acceso abierto
Palabra clave:Computational linguistics
Zipf’s law
Entropy (Information theory)
Scaling
Human language
Animal communication
Lingüística computacional
Entropia (Teoria de la informació)
Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Llenguatge natural
Descripción
Sumario:Here, assuming a general communication model where objects map to signals, a power function for the distribution of signal frequencies is derived. The model relies on the satisfaction of the receiver (hearer) communicative needs when the entropy of the number of objects per signal is maximized. Evidence of power distributions in a linguistic context (some of them with exponents clearly different from the typical ß ˜ 2 of Zipf's law) is reviewed and expanded. We support the view that Zipf's law reflects some sort of optimization but following a novel realistic approach where signals (e.g. words) are used according to the objects (e.g. meanings) they are linked to. Our results strongly suggest that many systems in nature use non-trivial strategies for easing the interpretation of a signal. Interestingly, constraining just the number of interpretations of signals does not lead to scaling.