A unified view of data-intensive flows in business intelligence systems : a survey

Data-intensive flows are central processes in today’s business intelligence (BI) systems, deploying different technologies to deliver data, from a multitude of data sources, in user-preferred and analysis-ready formats. To meet complex requirements of next generation BI systems, we often need an eff...

ver descrição completa

Detalhes bibliográficos
Autores: Jovanovic, Petar|||0000-0003-4635-6646, Romero Moral, Óscar|||0000-0001-6350-8328, Abelló Gamazo, Alberto|||0000-0002-3223-2186
Formato: artículo
Fecha de publicación:2016
País:España
Recursos:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/100671
Acesso em linha:https://hdl.handle.net/2117/100671
https://dx.doi.org/10.1007/978-3-662-54037-4_3
Access Level:acceso abierto
Palavra-chave:Data warehousing
Business intelligence
Workflow -- Management
Data-intensive flows
Workflow management
Gestor de dades
Espionatge industrial
Cicle de treball -- Gestió
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
Descrição
Resumo:Data-intensive flows are central processes in today’s business intelligence (BI) systems, deploying different technologies to deliver data, from a multitude of data sources, in user-preferred and analysis-ready formats. To meet complex requirements of next generation BI systems, we often need an effective combination of the traditionally batched extract-transform-load (ETL) processes that populate a data warehouse (DW) from integrated data sources, and more real-time and operational data flows that integrate source data at runtime. Both academia and industry thus must have a clear understanding of the foundations of data-intensive flows and the challenges of moving towards next generation BI environments. In this paper we present a survey of today’s research on data-intensive flows and the related fundamental fields of database theory. The study is based on a proposed set of dimensions describing the important challenges of data-intensive flows in the next generation BI setting. As a result of this survey, we envision an architecture of a system for managing the lifecycle of data-intensive flows. The results further provide a comprehensive understanding of data-intensive flows, recognizing challenges that still are to be addressed, and how the current solutions can be applied for addressing these challenges.