Quadratic Programming Feature Selection

Identifying a subset of features that preserves classification accuracy is a problem of growing importance, because of the increasing size and dimensionality of real-world data sets. We propose a new feature selection method, named Quadratic Programming Feature Selection (QPFS), that reduces the tas...

Descripción completa

Detalles Bibliográficos
Autores: Rodríguez-Luján, Irene, Elkan, Charles, Santa Cruz Fernández, Carlos, Huerta, Ramón
Tipo de recurso: artículo
Fecha de publicación:2010
País:España
Institución:Universidad Autónoma de Madrid
Repositorio:Biblos-e Archivo. Repositorio Institucional de la UAM
Idioma:inglés
OAI Identifier:oai:repositorio.uam.es:10486/663723
Acceso en línea:http://hdl.handle.net/10486/663723
Access Level:acceso abierto
Palabra clave:Feature selection
Quadratic programming
Nyström method
Large data set
Highdimensional data
Informática
Descripción
Sumario:Identifying a subset of features that preserves classification accuracy is a problem of growing importance, because of the increasing size and dimensionality of real-world data sets. We propose a new feature selection method, named Quadratic Programming Feature Selection (QPFS), that reduces the task to a quadratic optimization problem. In order to limit the computational complexity of solving the optimization problem, QPFS uses the Nystr¨om method for approximate matrix diagonalization. QPFS is thus capable of dealing with very large data sets, for which the use of other methods is computationally expensive. In experiments with small and medium data sets, the QPFS method leads to classification accuracy similar to that of other successful techniques. For large data sets, QPFS is superior in terms of computational efficiency.