On more realistic environment distributions for defining, evaluating and developing intelligence

One insightful view of the notion of intelligence is the ability to perform well in a diverse set of tasks, problems or environments. One of the key issues is therefore the choice of this set, which can be formalised as a `distribution¿. Formalising and properly defining this distribution is an impo...

Descripción completa

Detalles Bibliográficos
Autores: Hernández-Orallo, José|||0000-0001-9746-7632, Dowe, David L., España Cubillo, Sergio, Hernández-Lloreda, M. Victoria, Insa Cabrera, Javier
Tipo de recurso: capítulo de libro
Fecha de publicación:2011
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/35938
Acceso en línea:https://riunet.upv.es/handle/10251/35938
Access Level:acceso abierto
Palabra clave:Intelligence
Evolutionary Computation
Artificial Life
Social Intelligence
Intelligence Test
Universal Distribution
LENGUAJES Y SISTEMAS INFORMATICOS
id ES_8b104fd07addeb73e84604d87ea86de2
oai_identifier_str oai:riunet.upv.es:10251/35938
network_acronym_str ES
network_name_str España
repository_id_str
spelling On more realistic environment distributions for defining, evaluating and developing intelligenceHernández-Orallo, José|||0000-0001-9746-7632Dowe, David L.España Cubillo, SergioHernández-Lloreda, M. VictoriaInsa Cabrera, JavierIntelligenceEvolutionary ComputationArtificial LifeSocial IntelligenceIntelligence TestUniversal DistributionLENGUAJES Y SISTEMAS INFORMATICOSOne insightful view of the notion of intelligence is the ability to perform well in a diverse set of tasks, problems or environments. One of the key issues is therefore the choice of this set, which can be formalised as a `distribution¿. Formalising and properly defining this distribution is an important challenge to understand what intelligence is and to achieve artificial general intelligence (AGI). In this paper, we agree with previous criticisms that a universal distribution using a reference universal Turing machine (UTM) over tasks, environments, etc., is perhaps amuch too general distribution, since, e.g., the probability of other agents appearing on the scene or having some social interaction is almost 0 for many reference UTMs. Instead, we propose the notion of Darwin-Wallace distribution for environments, which is inspired by biological evolution, artificial life and evolutionary computation. However, although enlightening about where and how intelligence should excel, this distribution has so many options and is uncomputable in so many ways that we certainly need a more practical alternative. We propose the use of intelligence tests over multi-agent systems, in such a way that agents with a certified level of intelligence at a certain degree are used to construct the tests for the next degree. This constructive methodology can then be used as a more realistic intelligence test and also as a testbed for developing and evaluating AGI systems.We thank the anonymous reviewers for their helpful comments. We also thank the funding from the Spanish MEC and MICINN for projects TIN2009-06078-E/TIN, Consolider-Ingenio CSD2007-00022 and TIN2010-21062- C02, for MEC FPU grant AP2006-02323, and Generalitat Valenciana for Prometeo/2008/051Springer Verlag (Germany)Departamento de Sistemas Informáticos y ComputaciónEscuela Técnica Superior de Ingeniería InformáticaInstituto Universitario Valenciano de Investigación en Inteligencia ArtificialMinisterio de Ciencia e InnovaciónMinisterio de Educación y CienciaGeneralitat ValencianaRepositorio Institucional de la Universitat Politècnica de València Riunet20112011-01-01book parthttp://purl.org/coar/resource_type/c_3248VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/bookPartapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/35938reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengMinisterio de Ciencia e Innovación http://dx.doi.org/10.13039/501100004837 TIN2009-06078-E ANYTIME UNIVERSAL INTELLIGENCEMinisterio de Educación y Ciencia https://doi.org/10.13039/501100008743 CSD2007-00022 Agreement TechnologiesMinisterio de Educación y Ciencia https://doi.org/10.13039/501100008743 AP2006-0232 AP2006-0232Generalitat Valenciana https://doi.org/10.13039/501100003359 PROMETEO08%2F2008%2F051 Advances on Agreement Technologies for Computational Entities (atforce)Ministerio de Ciencia e Innovación http://dx.doi.org/10.13039/501100004837 TIN2010-21062-C02-02 SWEETLOGICS-UPVopen accesshttp://purl.org/coar/access_right/c_abf2Reserva de todos los derechoshttp://rightsstatements.org/vocab/InC/1.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/359382026-06-13T07:49:27Z
dc.title.none.fl_str_mv On more realistic environment distributions for defining, evaluating and developing intelligence
title On more realistic environment distributions for defining, evaluating and developing intelligence
spellingShingle On more realistic environment distributions for defining, evaluating and developing intelligence
Hernández-Orallo, José|||0000-0001-9746-7632
Intelligence
Evolutionary Computation
Artificial Life
Social Intelligence
Intelligence Test
Universal Distribution
LENGUAJES Y SISTEMAS INFORMATICOS
title_short On more realistic environment distributions for defining, evaluating and developing intelligence
title_full On more realistic environment distributions for defining, evaluating and developing intelligence
title_fullStr On more realistic environment distributions for defining, evaluating and developing intelligence
title_full_unstemmed On more realistic environment distributions for defining, evaluating and developing intelligence
title_sort On more realistic environment distributions for defining, evaluating and developing intelligence
dc.creator.none.fl_str_mv Hernández-Orallo, José|||0000-0001-9746-7632
Dowe, David L.
España Cubillo, Sergio
Hernández-Lloreda, M. Victoria
Insa Cabrera, Javier
author Hernández-Orallo, José|||0000-0001-9746-7632
author_facet Hernández-Orallo, José|||0000-0001-9746-7632
Dowe, David L.
España Cubillo, Sergio
Hernández-Lloreda, M. Victoria
Insa Cabrera, Javier
author_role author
author2 Dowe, David L.
España Cubillo, Sergio
Hernández-Lloreda, M. Victoria
Insa Cabrera, Javier
author2_role author
author
author
author
dc.contributor.none.fl_str_mv Departamento de Sistemas Informáticos y Computación
Escuela Técnica Superior de Ingeniería Informática
Instituto Universitario Valenciano de Investigación en Inteligencia Artificial
Ministerio de Ciencia e Innovación
Ministerio de Educación y Ciencia
Generalitat Valenciana
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Intelligence
Evolutionary Computation
Artificial Life
Social Intelligence
Intelligence Test
Universal Distribution
LENGUAJES Y SISTEMAS INFORMATICOS
topic Intelligence
Evolutionary Computation
Artificial Life
Social Intelligence
Intelligence Test
Universal Distribution
LENGUAJES Y SISTEMAS INFORMATICOS
description One insightful view of the notion of intelligence is the ability to perform well in a diverse set of tasks, problems or environments. One of the key issues is therefore the choice of this set, which can be formalised as a `distribution¿. Formalising and properly defining this distribution is an important challenge to understand what intelligence is and to achieve artificial general intelligence (AGI). In this paper, we agree with previous criticisms that a universal distribution using a reference universal Turing machine (UTM) over tasks, environments, etc., is perhaps amuch too general distribution, since, e.g., the probability of other agents appearing on the scene or having some social interaction is almost 0 for many reference UTMs. Instead, we propose the notion of Darwin-Wallace distribution for environments, which is inspired by biological evolution, artificial life and evolutionary computation. However, although enlightening about where and how intelligence should excel, this distribution has so many options and is uncomputable in so many ways that we certainly need a more practical alternative. We propose the use of intelligence tests over multi-agent systems, in such a way that agents with a certified level of intelligence at a certain degree are used to construct the tests for the next degree. This constructive methodology can then be used as a more realistic intelligence test and also as a testbed for developing and evaluating AGI systems.
publishDate 2011
dc.date.none.fl_str_mv 2011
2011-01-01
dc.type.none.fl_str_mv book part
http://purl.org/coar/resource_type/c_3248
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/bookPart
format bookPart
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/35938
url https://riunet.upv.es/handle/10251/35938
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv Ministerio de Ciencia e Innovación http://dx.doi.org/10.13039/501100004837 TIN2009-06078-E ANYTIME UNIVERSAL INTELLIGENCE
Ministerio de Educación y Ciencia https://doi.org/10.13039/501100008743 CSD2007-00022 Agreement Technologies
Ministerio de Educación y Ciencia https://doi.org/10.13039/501100008743 AP2006-0232 AP2006-0232
Generalitat Valenciana https://doi.org/10.13039/501100003359 PROMETEO08%2F2008%2F051 Advances on Agreement Technologies for Computational Entities (atforce)
Ministerio de Ciencia e Innovación http://dx.doi.org/10.13039/501100004837 TIN2010-21062-C02-02 SWEETLOGICS-UPV
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Springer Verlag (Germany)
publisher.none.fl_str_mv Springer Verlag (Germany)
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869412779666964480
score 15.300719