SETL: A programmable semantic extract-transform-load framework for semantic data warehouses

In order to create better decisions for business analytics, organizations increasingly use external structured, semi-structured, and unstructured data in addition to the (mostly structured) internal data. Current Extract-Transform-Load (ETL) tools are not suitable for this “open world scenario” beca...

Descripción completa

Detalles Bibliográficos
Autores: Deb Nath, Rudra Pratap, Hose, Katja, Bach Pedersen, Torben, Romero Moral, Óscar|||0000-0001-6350-8328
Tipo de recurso: artículo
Fecha de publicación:2017
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/113594
Acceso en línea:https://hdl.handle.net/2117/113594
https://dx.doi.org/10.1016/j.is.2017.01.005
Access Level:acceso abierto
Palabra clave:Semantic computing
Data warehousing
Expert systems (Computer science)
ETL
RDF
Semantic integration
Data warehouse
Semantic-aware
Knowledge base
Gestor de dades
Sistemes experts (Informàtica)
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
id ES_a3adf4ee58e328b42e92e0faa73b01c6
oai_identifier_str oai:upcommons.upc.edu:2117/113594
network_acronym_str ES
network_name_str España
repository_id_str
spelling SETL: A programmable semantic extract-transform-load framework for semantic data warehousesDeb Nath, Rudra PratapHose, KatjaBach Pedersen, TorbenRomero Moral, Óscar|||0000-0001-6350-8328Semantic computingData warehousingExpert systems (Computer science)ETLRDFSemantic integrationData warehouseSemantic-awareKnowledge baseGestor de dadesSistemes experts (Informàtica)Àrees temàtiques de la UPC::Informàtica::Sistemes d'informacióIn order to create better decisions for business analytics, organizations increasingly use external structured, semi-structured, and unstructured data in addition to the (mostly structured) internal data. Current Extract-Transform-Load (ETL) tools are not suitable for this “open world scenario” because they do not consider semantic issues in the integration processing. Current ETL tools neither support processing semantic data nor create a semantic Data Warehouse (DW), a repository of semantically integrated data. This paper describes our programmable Semantic ETL (SETL) framework. SETL builds on Semantic Web (SW) standards and tools and supports developers by offering a number of powerful modules, classes, and methods for (dimensional and semantic) DW constructs and tasks. Thus it supports semantic data sources in addition to traditional data sources, semantic integration, and creating or publishing a semantic (multidimensional) DW in terms of a knowledge base. A comprehensive experimental evaluation comparing SETL to a solution made with traditional tools (requiring much more hand-coding) on a concrete use case, shows that SETL provides better programmer productivity, knowledge base quality, and performance.Peer Reviewed20172017-08-0120182018-02-02journal articlehttp://purl.org/coar/resource_type/c_6501AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/2117/113594https://dx.doi.org/10.1016/j.is.2017.01.005reponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2Attribution-NonCommercial-NoDerivs 3.0 Spainhttp://creativecommons.org/licenses/by-nc-nd/3.0/es/info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/1135942026-05-27T15:37:01Z
dc.title.none.fl_str_mv SETL: A programmable semantic extract-transform-load framework for semantic data warehouses
title SETL: A programmable semantic extract-transform-load framework for semantic data warehouses
spellingShingle SETL: A programmable semantic extract-transform-load framework for semantic data warehouses
Deb Nath, Rudra Pratap
Semantic computing
Data warehousing
Expert systems (Computer science)
ETL
RDF
Semantic integration
Data warehouse
Semantic-aware
Knowledge base
Gestor de dades
Sistemes experts (Informàtica)
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
title_short SETL: A programmable semantic extract-transform-load framework for semantic data warehouses
title_full SETL: A programmable semantic extract-transform-load framework for semantic data warehouses
title_fullStr SETL: A programmable semantic extract-transform-load framework for semantic data warehouses
title_full_unstemmed SETL: A programmable semantic extract-transform-load framework for semantic data warehouses
title_sort SETL: A programmable semantic extract-transform-load framework for semantic data warehouses
dc.creator.none.fl_str_mv Deb Nath, Rudra Pratap
Hose, Katja
Bach Pedersen, Torben
Romero Moral, Óscar|||0000-0001-6350-8328
author Deb Nath, Rudra Pratap
author_facet Deb Nath, Rudra Pratap
Hose, Katja
Bach Pedersen, Torben
Romero Moral, Óscar|||0000-0001-6350-8328
author_role author
author2 Hose, Katja
Bach Pedersen, Torben
Romero Moral, Óscar|||0000-0001-6350-8328
author2_role author
author
author
dc.subject.none.fl_str_mv Semantic computing
Data warehousing
Expert systems (Computer science)
ETL
RDF
Semantic integration
Data warehouse
Semantic-aware
Knowledge base
Gestor de dades
Sistemes experts (Informàtica)
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
topic Semantic computing
Data warehousing
Expert systems (Computer science)
ETL
RDF
Semantic integration
Data warehouse
Semantic-aware
Knowledge base
Gestor de dades
Sistemes experts (Informàtica)
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
description In order to create better decisions for business analytics, organizations increasingly use external structured, semi-structured, and unstructured data in addition to the (mostly structured) internal data. Current Extract-Transform-Load (ETL) tools are not suitable for this “open world scenario” because they do not consider semantic issues in the integration processing. Current ETL tools neither support processing semantic data nor create a semantic Data Warehouse (DW), a repository of semantically integrated data. This paper describes our programmable Semantic ETL (SETL) framework. SETL builds on Semantic Web (SW) standards and tools and supports developers by offering a number of powerful modules, classes, and methods for (dimensional and semantic) DW constructs and tasks. Thus it supports semantic data sources in addition to traditional data sources, semantic integration, and creating or publishing a semantic (multidimensional) DW in terms of a knowledge base. A comprehensive experimental evaluation comparing SETL to a solution made with traditional tools (requiring much more hand-coding) on a concrete use case, shows that SETL provides better programmer productivity, knowledge base quality, and performance.
publishDate 2017
dc.date.none.fl_str_mv 2017
2017-08-01
2018
2018-02-02
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
AM
http://purl.org/coar/version/c_ab4af688f83e57aa
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/2117/113594
https://dx.doi.org/10.1016/j.is.2017.01.005
url https://hdl.handle.net/2117/113594
https://dx.doi.org/10.1016/j.is.2017.01.005
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution-NonCommercial-NoDerivs 3.0 Spain
http://creativecommons.org/licenses/by-nc-nd/3.0/es/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution-NonCommercial-NoDerivs 3.0 Spain
http://creativecommons.org/licenses/by-nc-nd/3.0/es/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:UPCommons. Portal del coneixement obert de la UPC
instname:Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
reponame_str UPCommons. Portal del coneixement obert de la UPC
collection UPCommons. Portal del coneixement obert de la UPC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869415417242451968
score 15.300719

Similares en LA Referencia