A computational analysis of general intelligence tests for evaluating cognitive development

[EN] The progression in several cognitive tests for the same subjects at different ages provides valuable information about their cognitive development. One question that has caught recent interest is whether the same approach can be used to assess the cognitive development of artificial systems. In...

ver descrição completa

Detalhes bibliográficos
Autores: Martínez-Plumed, Fernando|||0000-0003-2902-6477, Ferri Ramírez, César|||0000-0002-8975-1120, Hernández-Orallo, José|||0000-0001-9746-7632, Ramírez Quintana, María José|||0000-0002-0559-3568
Formato: artículo
Fecha de publicación:2017
País:España
Recursos:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/102288
Acesso em linha:https://riunet.upv.es/handle/10251/102288
Access Level:acceso abierto
Palavra-chave:Cognitive development assessment
Intelligence tests
Task difficulty
General learning
Artificial Intelligence evaluation
Inductive programming
LENGUAJES Y SISTEMAS INFORMATICOS
id ES_3b62f6cef307c1b4e02ca8f3b650c265
oai_identifier_str oai:riunet.upv.es:10251/102288
network_acronym_str ES
network_name_str España
repository_id_str
spelling A computational analysis of general intelligence tests for evaluating cognitive developmentMartínez-Plumed, Fernando|||0000-0003-2902-6477Ferri Ramírez, César|||0000-0002-8975-1120Hernández-Orallo, José|||0000-0001-9746-7632Ramírez Quintana, María José|||0000-0002-0559-3568Cognitive development assessmentIntelligence testsTask difficultyGeneral learningArtificial Intelligence evaluationInductive programmingLENGUAJES Y SISTEMAS INFORMATICOS[EN] The progression in several cognitive tests for the same subjects at different ages provides valuable information about their cognitive development. One question that has caught recent interest is whether the same approach can be used to assess the cognitive development of artificial systems. In particular, can we assess whether the fluid or crystallised intelligence of an artificial cognitive system is changing during its cognitive development as a result of acquiring more concepts? In this paper, we address several IQ tests problems (odd-one-out problems, Raven s Progressive Matrices and Thurstone s letter series) with a general learning system that is not particularly designed on purpose to solve intelligence tests. The goal is to better understand the role of the basic cognitive perational constructs (such as identity, difference, order, counting, logic, etc.) that are needed to solve these intelligence test problems and serve as a proof-of-concept for evaluation in other developmental problems. From here, we gain some insights into the characteristics and usefulness of these tests and how careful we need to be when applying human test problems to assess the abilities and cognitive development of robots and other artificial cognitive systems.This work has been partially supported by the EU (FEDER) and the Spanish MINECO under grants TIN 2015-69175-C4-1-R and TIN 2013-45732-C4-1-P, and by Generalitat Valenciana under grant PROMETEOII/2015/013.ElsevierDepartamento de Sistemas Informáticos y ComputaciónEscuela Técnica Superior de Ingeniería InformáticaInstituto Universitario Valenciano de Investigación en Inteligencia ArtificialGeneralitat ValencianaMinisterio de Economía, Industria y CompetitividadRepositorio Institucional de la Universitat Politècnica de València Riunet20172017-01-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/102288reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2015-69175-C4-1-R SOLUCIONES EFECTIVAS BASADAS EN LA LOGICAGeneralitat Valenciana https://doi.org/10.13039/501100003359 PROMETEOII%2F2015%2F013 SmartLogic: Logic Technologies for Software Security and PerformanceMinisterio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2013-45732-C4-1-P UNA APROXIMACION DECLARATIVA AL MODELADO, ANALISIS Y RESOLUCION DE PROBLEMASopen accesshttp://purl.org/coar/access_right/c_abf2Reserva de todos los derechoshttp://rightsstatements.org/vocab/InC/1.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/1022882026-06-13T07:49:27Z
dc.title.none.fl_str_mv A computational analysis of general intelligence tests for evaluating cognitive development
title A computational analysis of general intelligence tests for evaluating cognitive development
spellingShingle A computational analysis of general intelligence tests for evaluating cognitive development
Martínez-Plumed, Fernando|||0000-0003-2902-6477
Cognitive development assessment
Intelligence tests
Task difficulty
General learning
Artificial Intelligence evaluation
Inductive programming
LENGUAJES Y SISTEMAS INFORMATICOS
title_short A computational analysis of general intelligence tests for evaluating cognitive development
title_full A computational analysis of general intelligence tests for evaluating cognitive development
title_fullStr A computational analysis of general intelligence tests for evaluating cognitive development
title_full_unstemmed A computational analysis of general intelligence tests for evaluating cognitive development
title_sort A computational analysis of general intelligence tests for evaluating cognitive development
dc.creator.none.fl_str_mv Martínez-Plumed, Fernando|||0000-0003-2902-6477
Ferri Ramírez, César|||0000-0002-8975-1120
Hernández-Orallo, José|||0000-0001-9746-7632
Ramírez Quintana, María José|||0000-0002-0559-3568
author Martínez-Plumed, Fernando|||0000-0003-2902-6477
author_facet Martínez-Plumed, Fernando|||0000-0003-2902-6477
Ferri Ramírez, César|||0000-0002-8975-1120
Hernández-Orallo, José|||0000-0001-9746-7632
Ramírez Quintana, María José|||0000-0002-0559-3568
author_role author
author2 Ferri Ramírez, César|||0000-0002-8975-1120
Hernández-Orallo, José|||0000-0001-9746-7632
Ramírez Quintana, María José|||0000-0002-0559-3568
author2_role author
author
author
dc.contributor.none.fl_str_mv Departamento de Sistemas Informáticos y Computación
Escuela Técnica Superior de Ingeniería Informática
Instituto Universitario Valenciano de Investigación en Inteligencia Artificial
Generalitat Valenciana
Ministerio de Economía, Industria y Competitividad
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Cognitive development assessment
Intelligence tests
Task difficulty
General learning
Artificial Intelligence evaluation
Inductive programming
LENGUAJES Y SISTEMAS INFORMATICOS
topic Cognitive development assessment
Intelligence tests
Task difficulty
General learning
Artificial Intelligence evaluation
Inductive programming
LENGUAJES Y SISTEMAS INFORMATICOS
description [EN] The progression in several cognitive tests for the same subjects at different ages provides valuable information about their cognitive development. One question that has caught recent interest is whether the same approach can be used to assess the cognitive development of artificial systems. In particular, can we assess whether the fluid or crystallised intelligence of an artificial cognitive system is changing during its cognitive development as a result of acquiring more concepts? In this paper, we address several IQ tests problems (odd-one-out problems, Raven s Progressive Matrices and Thurstone s letter series) with a general learning system that is not particularly designed on purpose to solve intelligence tests. The goal is to better understand the role of the basic cognitive perational constructs (such as identity, difference, order, counting, logic, etc.) that are needed to solve these intelligence test problems and serve as a proof-of-concept for evaluation in other developmental problems. From here, we gain some insights into the characteristics and usefulness of these tests and how careful we need to be when applying human test problems to assess the abilities and cognitive development of robots and other artificial cognitive systems.
publishDate 2017
dc.date.none.fl_str_mv 2017
2017-01-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/102288
url https://riunet.upv.es/handle/10251/102288
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2015-69175-C4-1-R SOLUCIONES EFECTIVAS BASADAS EN LA LOGICA
Generalitat Valenciana https://doi.org/10.13039/501100003359 PROMETEOII%2F2015%2F013 SmartLogic: Logic Technologies for Software Security and Performance
Ministerio de Economía y Competitividad http://dx.doi.org/10.13039/501100003329 TIN2013-45732-C4-1-P UNA APROXIMACION DECLARATIVA AL MODELADO, ANALISIS Y RESOLUCION DE PROBLEMAS
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Elsevier
publisher.none.fl_str_mv Elsevier
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869406303028248576
score 15,300719