Regularization, sparse recovery, and median-of-means tournaments

We introduce a regularized risk minimization procedure for regression function estimation. The procedure is based on median-of-means tournaments, introduced by the authors in Lugosi and Mendelson (2018) and achieves near optimal accuracy and confidence under general conditions, including heavy-taile...

Descripción completa

Detalles Bibliográficos
Autores: Lugosi, Gábor, Mendelson, Shahar
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2019
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10230/72104
Acceso en línea:http://hdl.handle.net/10230/72104
http://dx.doi.org/10.3150/18-BEJ1046
Access Level:acceso abierto
Palabra clave:Lasso
Median-of-means tournament
Regularized risk minimization
Robust regression
Slope
Descripción
Sumario:We introduce a regularized risk minimization procedure for regression function estimation. The procedure is based on median-of-means tournaments, introduced by the authors in Lugosi and Mendelson (2018) and achieves near optimal accuracy and confidence under general conditions, including heavy-tailed predictor and response variables. It outperforms standard regularized empirical risk minimization procedures such as LASSO or SLOPE in heavy-tailed problems.