Exploiting diversity of margin-based classifiers

An experimental comparison among Support Vector Machines, AdaBoost and a recently proposed model for maximizing the margin with Feed-forward Neural Networks has been made on a real-world classification problem, namely Text Categorization. The results obtained when comparing their agreement on the pr...

Descripción completa

Detalles Bibliográficos
Autores: Romero Merino, Enrique|||0000-0003-2404-5716, Carreras Pérez, Xavier, Màrquez Villodre, Lluís|||0009-0009-0593-368X
Tipo de recurso: informe técnico
Fecha de publicación:2003
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/96843
Acceso en línea:https://hdl.handle.net/2117/96843
Access Level:acceso abierto
Palabra clave:Support Vector Machines
AdaBoost
Text categorization
Margin-based classifiers
Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial
Descripción
Sumario:An experimental comparison among Support Vector Machines, AdaBoost and a recently proposed model for maximizing the margin with Feed-forward Neural Networks has been made on a real-world classification problem, namely Text Categorization. The results obtained when comparing their agreement on the predictions show that similar performance does not imply similar predictions, suggesting that different models can be combined to obtain better performance. As a consequence of the study, we derived a very simple confidence measure of the prediction of the tested margin-based classifiers. This measure is based on the margin curve. The combination of margin-based classifiers with this confidence measure lead to a marked improvement on the performance of the system, when combined with several well-known combination schemes.