An empirical overview of the No Free Lunch Theorem and its effect on Real-World Machine Learning Classification

A sizable amount of research has been done to improve the mechanisms for knowledge extraction such as machine learning classification or regression. Quite unintuitively, the no free lunch (NFL) theorem states that all optimization problem strategies perform equally well when averaged over all possib...

Descripción completa

Detalles Bibliográficos
Autores: Gomez Guillen, David, Rojas Espinosa, Alfonso|||0000-0002-2630-4438
Tipo de recurso: artículo
Fecha de publicación:2016
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/81906
Acceso en línea:https://hdl.handle.net/2117/81906
https://dx.doi.org/10.1162/NECO_a_00793
Access Level:acceso abierto
Palabra clave:Neural computers
Machine learning
Ordinadors neuronals
Aprenentatge automàtic
Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial::Aprenentatge automàtic
Descripción
Sumario:A sizable amount of research has been done to improve the mechanisms for knowledge extraction such as machine learning classification or regression. Quite unintuitively, the no free lunch (NFL) theorem states that all optimization problem strategies perform equally well when averaged over all possible problems. This fact seems to clash with the effort put forth toward better algorithms. This letter explores empirically the effect of the NFL theorem on some popular machine learning classification techniques over real-world data sets.