MC-SQ and MC-MQ: Ensembles for Multi-Class Quantification

Quantification research proposes methods to estimate the class distribution in an independent sample. Quantification methods find applications in areas that rely on estimated aggregated quantities, such as epidemiology, sentiment analysis, political research, and ecological surveillance. For instanc...

Descripción completa

Detalles Bibliográficos
Autores: Donyavi, Zahra, Serapiao, Adriane B. S. [UNESP], Batista, Gustavo
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2024
País:Brasil
Institución:Universidade Estadual Paulista (UNESP)
Repositorio:Repositório Institucional da UNESP
Idioma:inglés
OAI Identifier:oai:repositorio.unesp.br:11449/307511
Acceso en línea:http://dx.doi.org/10.1109/TKDE.2024.3372011
https://hdl.handle.net/11449/307511
Access Level:acceso abierto
Palabra clave:Class probability estimation
ensembles
machine learning
multi-class
prevalence estimation
quantification
Descripción
Sumario:Quantification research proposes methods to estimate the class distribution in an independent sample. Quantification methods find applications in areas that rely on estimated aggregated quantities, such as epidemiology, sentiment analysis, political research, and ecological surveillance. For instance, epidemiologists are often concerned with the dynamics of the number of disease cases across space and time. Thus, while classification predicts individual subjects, quantifiers are the methods that directly estimate the number of cases. Although quantification is a thriving area of research, with numerous approaches proposed in the last decade, most focus has been on binary-class quantifiers. One common approach for multi-class quantification is the one-versus-all (OVA) approach, but empirical evidence suggests its performance is suboptimal. This paper's first contribution is to elucidate why OVA quantifiers struggle to perform well in multi-class settings due to a distribution shift. To circumvent this problem, our second proposal is two new multi-class quantifiers based on ensemble learning that significantly improve performance for binary and multi-class settings. Our comprehensive experimental setup with 37 state-of-the-art (single and ensemble) quantifiers shows that our ensembles are the best-performing quantifiers and rank first in a recent quantification competition.