Supervised learning by means of accuracy-aware evolutionary algorithms

This paper describes a new approach, HIerarchical DEcision Rules (HIDER), for learning generalizable rules in continuous and discrete domains based on evolutionary algorithms. The main contributions of our approach are the integration of both binary and real evolutionary coding; the use of specific...

Full description

Bibliographic Details
Authors: Riquelme Santos, José Cristóbal, Aguilar Ruiz, Jesús Salvador, Valle Sevillano, Carmelo del
Format: article
Status:Versión aceptada para publicación
Publication Date:2003
Country:España
Institution:Universidad de Sevilla (US)
Repository:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/42890
Online Access:http://hdl.handle.net/11441/42890
https://doi.org/10.1016/S0020-0255(03)00175-0
Access Level:Open access
Keyword:evolutionary algorithms
supervised learning
decision trees
Description
Summary:This paper describes a new approach, HIerarchical DEcision Rules (HIDER), for learning generalizable rules in continuous and discrete domains based on evolutionary algorithms. The main contributions of our approach are the integration of both binary and real evolutionary coding; the use of specific operators; the relaxing coefficient to construct more flexible classifiers by indicating how general, with respect to the errors, decision rules must be; the coverage factor in the fitness function, which makes possible a quick expansion of the rule size; and the implicit hierarchy when rules are being obtained. HIDER is accuracy-aware since it can control the maximum allowed error for each decision rule. We have tested our system on real data from the UCI Repository. The results of a 10-fold cross-validation are compared to C4.5’s and they show a significant improvement with respect to the number of rules and the error rate.