Variable selection for linear regression in large databases: exact methods

This paper analyzes the variable selection problem in the context of Linear Regression for large databases. The problem consists of selecting a small subset of independent variables that can perform the prediction task optimally. This problem has a wide range of applications. One important type of a...

Descripción completa

Detalles Bibliográficos
Autores: Pacheco Bonrostro, Joaquín, Casado Yusta, Silvia
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2020
País:España
Institución:Universidad de Burgos (UBU)
Repositorio:Repositorio Institucional de la Universidad de Burgos (RIUBU)
OAI Identifier:oai:riubu.ubu.es:10259/8437
Acceso en línea:http://hdl.handle.net/10259/8437
Access Level:acceso abierto
Palabra clave:Variable selection
Linear regression
Branch & Bound methods
Heuristics
Economía
Matemáticas
Economics
Mathematics
Descripción
Sumario:This paper analyzes the variable selection problem in the context of Linear Regression for large databases. The problem consists of selecting a small subset of independent variables that can perform the prediction task optimally. This problem has a wide range of applications. One important type of application is the design of composite indicators in various areas (sociology and economics, for example). Other important applications of variable selection in linear regression can be found in fields such as chemometrics, genetics, and climate prediction, among many others. For this problem, we propose a Branch & Bound method. This is an exact method and therefore guarantees optimal solutions. We also provide strategies that enable this method to be applied in very large databases (with hundreds of thousands of cases) in a moderate computation time. A series of computational experiments shows that our method performs well compared to well-known methods in the literature and with commercial software.