On the evolutionary weighting of neighbours and features in the k-nearest neighbour rule

This paper presents an evolutionary method for modifying the behaviour of the k-Nearest-Neighbour clas sifier (kNN) called Simultaneous Weighting of Attributes and Neighbours (SWAN). Unlike other weighting methods, SWAN presents the ability of adjusting the contribution of the neighbours and the sig...

Descripción completa

Detalles Bibliográficos
Autores: Mateos García, Daniel, García Gutiérrez, Jorge, Riquelme Santos, José Cristóbal
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2019
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/132783
Acceso en línea:https://hdl.handle.net/11441/132783
https://doi.org/10.1016/j.neucom.2016.08.159
Access Level:acceso abierto
Palabra clave:Evolutionary Computation
Neighbours weighting
Feature weighting
Descripción
Sumario:This paper presents an evolutionary method for modifying the behaviour of the k-Nearest-Neighbour clas sifier (kNN) called Simultaneous Weighting of Attributes and Neighbours (SWAN). Unlike other weighting methods, SWAN presents the ability of adjusting the contribution of the neighbours and the significance of the features of the data. The optimization process focuses on the search of two real-valued vectors. One of them represents the votes of neighbours, and the other one represents the weight of each feature. The synergy between the two sets of weights found in the optimization process helps to improve significantly, the classification accuracy. The results on 35 datasets from the UCI repository suggest that SWAN statistically outperforms the other weighted kNN methods