Synthetic Oversampling of Instances Using Clustering

Imbalanced data sets, in the class distribution, is common to many real world applications. As many classifiers tend to degrade their performance over the minority class, several approaches have been proposed to deal with this problem. In this paper, we propose two new cluster-based oversampling met...

ver descrição completa

Detalhes bibliográficos
Autores: Atlántida Irene Sánchez Vivar, Eduardo Francisco Morales Manzanares, Jesús Antonio González Bernal
Tipo de documento: artigo
Estado:Versión aceptada para publicación
Data de publicação:2013
País:México
Recursos:Instituto Nacional de Astrofísica, Óptica y Electrónica
Repositório:Repositorio Institucional del INAOE
Idioma:inglês
OAI Identifier:oai:inaoe.repositorioinstitucional.mx:1009/2395
Acesso em linha:http://inaoe.repositorioinstitucional.mx/jspui/handle/1009/2395
Access Level:Acceso aberto
Palavra-chave:info:eu-repo/classification/Imbalanced datasets/Imbalanced datasets
info:eu-repo/classification/Oversampling/Oversampling
info:eu-repo/classification/Cluster-based oversampling/Cluster-based oversampling
info:eu-repo/classification/Jittering/Jittering
info:eu-repo/classification/cti/1
info:eu-repo/classification/cti/12
info:eu-repo/classification/cti/1203
Descrição
Resumo:Imbalanced data sets, in the class distribution, is common to many real world applications. As many classifiers tend to degrade their performance over the minority class, several approaches have been proposed to deal with this problem. In this paper, we propose two new cluster-based oversampling methods, SOI-C and SOI-CJ. The proposed methods create clusters from the minority class instances and generate synthetic instances inside those clusters. In contrast with other oversampling methods, the proposed approaches avoid creating new instances in majority class regions. They are more robust to noisy examples (the number of new instances generated per cluster is proportional to the cluster's size). The clusters are automatically generated. Our new methods do not need tuning parameters, and they can deal both with numerical and nominal attributes. The two methods were tested with twenty artificial datasets and twenty three datasets from the UCI Machine Learning repository. For our experiments, we used six classifiers and results were evaluated with TPR, precision, F-measure, and AUC measures, which are more suitable for class imbalanced datasets. We performed ANOVA and paired t-tests to show that the proposed methods are competitive and in many cases significantly better than the rest of the oversampling methods used during the comparison.