RadarTSR: A new algorithm for cellwise and rowwise outlier detection and missing data imputation

[EN] High-dimensional and multivariate data sets often contain missing data and/or cellwise/rowwise outliers. Whereas several solutions have been proposed to deal with each one of these issues independently, the number of suitable techniques that simultaneously confront these phenomena is drasticall...

Descripción completa

Detalles Bibliográficos
Autores: González-Cebrián, Alba, Folch-Fortuny, Abel, Arteaga, Francisco, Ferrer, Alberto|||0000-0001-7244-5947
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/221639
Acceso en línea:https://riunet.upv.es/handle/10251/221639
Access Level:acceso abierto
Palabra clave:Missing data
PCA
Outliers
Descripción
Sumario:[EN] High-dimensional and multivariate data sets often contain missing data and/or cellwise/rowwise outliers. Whereas several solutions have been proposed to deal with each one of these issues independently, the number of suitable techniques that simultaneously confront these phenomena is drastically reduced. In this paper, we introduce RadarTSR, a Robust Adaptation for Data with Anomalous Rows and/or cells of the Trimmed Scores Regression method, which is based on a Principal Component Analysis (PCA). RadarTSR detects cellwise and rowwise outliers, imputes missing data without the harmful effect of outliers, and, if grouped rowwise outliers are detected, RadarTSR imputes them with their own model. The performance of RadarTSR is compared to the MacroPCA algorithm; as far as we are concerned, the only proposal that deals with missing data and contemplates these two different types of outliers. Several simulated and real data sets are used. The RadarTSR code is available in Matlab.