CALA: An unsupervised URL-based web page classification system

Unsupervised web page classification refers to the problem of clustering the pages in a web site so that each cluster includes a set of web pages that can be classified using a unique class. The existing proposals to perform web page classification do not fulfill a number of requirements that would...

Descripción completa

Detalles Bibliográficos
Autores: Hernández Salmerón, Inmaculada Concepción, Rivero, Carlos R., Ruiz Cortés, David, Corchuelo Gil, Rafael
Tipo de recurso: artículo
Estado:Versión enviada para evaluación y publicación
Fecha de publicación:2014
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/66444
Acceso en línea:http://hdl.handle.net/11441/66444
https://doi.org/10.1016/j.knosys.2013.12.019
Access Level:acceso abierto
Palabra clave:Web Page Classification
URL Classification
URL Patterns
Enterprise web information integration
Web Page Clustering
Descripción
Sumario:Unsupervised web page classification refers to the problem of clustering the pages in a web site so that each cluster includes a set of web pages that can be classified using a unique class. The existing proposals to perform web page classification do not fulfill a number of requirements that would make them suitable for enterprise web information integration, namely: to be based on a lightweight crawling, so as to avoid interfering with the normal operation of the web site, to be unsupervised, which avoids the need for a training set of pre-classified pages, or to use features from outside the page to be classified, which avoids having to download it. In this article, we propose CALA, a new automated proposal to generate URL-based web page classifiers. Our proposal builds a number of URL patterns that represent the different classes of pages in a web site, so further pages can be classified by matching their URLs to the patterns. Its salient features are that it fulfills all of the previous requirements, and it has been validated by a number of experiments using real-world, top-visited web sites. Our validation proves that CALA is very effective and efficient in practice.