Trinity: On Using Trinary Trees for Unsupervised Web Data Extraction

Web data extractors are used to extract data from web documents in order to feed automated processes. In this article, we propose a technique that works on two or more web documents generated by the same server-side template and learns a regular expression that models it and can later be used to ext...

Descripción completa

Detalles Bibliográficos
Autores: Sleiman, Hassan A., Corchuelo Gil, Rafael
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2014
País:España
Institución:Universidad de Sevilla (US)
Repositorio:idUS. Depósito de Investigación de la Universidad de Sevilla
OAI Identifier:oai:idus.us.es:11441/143731
Acceso en línea:https://hdl.handle.net/11441/143731
https://doi.org/10.1109/TKDE.2013.161
Access Level:acceso abierto
Palabra clave:Web data extraction
automatic wrapper generation
wrappers
unsupervised learning
Descripción
Sumario:Web data extractors are used to extract data from web documents in order to feed automated processes. In this article, we propose a technique that works on two or more web documents generated by the same server-side template and learns a regular expression that models it and can later be used to extract data from similar documents. The technique builds on the hypothesis that the template introduces some shared patterns that do not provide any relevant data and can thus be ignored. We have evaluated and compared our technique to others in the literature on a large collection of web documents; our results demonstrate that our proposal performs better than the others and that input errors do not have a negative impact on its effectiveness; furthermore, its efficiency can be easily boosted by means of a couple of parameters, without sacrificing its effectiveness.