Efficient ensembles of distance-based label ranking trees

Ensemble of label ranking trees (LRTs) are currently the state-of-the-art approaches to the label ranking problem. Recently, bagging, boosting,and random forest methods have been proposed, all based on the LRT algorithm, which adapts regression/ classification trees to the label classification probl...

Descripción completa

Detalles Bibliográficos
Autores: González Rodrigo, Enrique, Alfaro Jiménez, Juan Carlos, Aledo Sánchez, Juan Ángel, Gámez Martín, José Antonio
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Universidad de Castilla-La Mancha
Repositorio:RUIdeRA. Repositorio Institucional de la UCLM
OAI Identifier:oai:ruidera.uclm.es:10578/41273
Acceso en línea:https://onlinelibrary.wiley.com/doi/full/10.1111/exsy.13525
https://hdl.handle.net/10578/41273
Access Level:acceso abierto
Palabra clave:Ensemble methods
Generalized Kendall distance
Label ranking
Machine learning
Preference learning
Descripción
Sumario:Ensemble of label ranking trees (LRTs) are currently the state-of-the-art approaches to the label ranking problem. Recently, bagging, boosting,and random forest methods have been proposed, all based on the LRT algorithm, which adapts regression/ classification trees to the label classification problem. The LRT algorithm uses theoretically grounded Mallows probability distribution to select the best split when growing the tree, and an EM-type process to complete the rankings on the training data when they are incomplete. These two steps have proven to be accurate, but require a large computational effort. This article proposes two alternative methods that replace the use of the Mallows distribution with distance based criteria to select the best split a teach in nernode of the tree.More over, these distance-based criteria allow dealing with incomplete rankings natively, so avoiding the completion process. We have carried out an extensive experimental evaluation, which shows that (1) the integration of the two proposed modifications to the LRT algorithm in to ensemble methods (bagg in gandr and om forest) are an order of magnitude faster than using the original Mallows-based LRT algorithm; (2) ensembles using the proposed LRT methods are significantly more accurate in the presence of incomplete rankings, while they ar eat least as accurate in the completecase; and(3) the two modified LRT algorithms are also a norder of magnitude faster than the Mallows-based LRT, while they are at least as accurate as the Mallows-based LRT on both complete and incomplete rankings.