SETL: A programmable semantic extract-transform-load framework for semantic data warehouses

In order to create better decisions for business analytics, organizations increasingly use external structured, semi-structured, and unstructured data in addition to the (mostly structured) internal data. Current Extract-Transform-Load (ETL) tools are not suitable for this “open world scenario” beca...

Descripción completa

Detalles Bibliográficos
Autores: Deb Nath, Rudra Pratap, Hose, Katja, Bach Pedersen, Torben, Romero Moral, Óscar|||0000-0001-6350-8328
Tipo de recurso: artículo
Fecha de publicación:2017
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/113594
Acceso en línea:https://hdl.handle.net/2117/113594
https://dx.doi.org/10.1016/j.is.2017.01.005
Access Level:acceso abierto
Palabra clave:Semantic computing
Data warehousing
Expert systems (Computer science)
ETL
RDF
Semantic integration
Data warehouse
Semantic-aware
Knowledge base
Gestor de dades
Sistemes experts (Informàtica)
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
Descripción
Sumario:In order to create better decisions for business analytics, organizations increasingly use external structured, semi-structured, and unstructured data in addition to the (mostly structured) internal data. Current Extract-Transform-Load (ETL) tools are not suitable for this “open world scenario” because they do not consider semantic issues in the integration processing. Current ETL tools neither support processing semantic data nor create a semantic Data Warehouse (DW), a repository of semantically integrated data. This paper describes our programmable Semantic ETL (SETL) framework. SETL builds on Semantic Web (SW) standards and tools and supports developers by offering a number of powerful modules, classes, and methods for (dimensional and semantic) DW constructs and tasks. Thus it supports semantic data sources in addition to traditional data sources, semantic integration, and creating or publishing a semantic (multidimensional) DW in terms of a knowledge base. A comprehensive experimental evaluation comparing SETL to a solution made with traditional tools (requiring much more hand-coding) on a concrete use case, shows that SETL provides better programmer productivity, knowledge base quality, and performance.