Implementation of the ETL process and analysis with real-time visualization of data from UPC infrastructure

The project implements from scratch the whole process of data extraction, transformation and loading to perform a set of descriptive and predictive analyses that will be visualized in a report with several graphics. The data used in this study contains information from the UPC related to the users a...

Descripción completa

Detalles Bibliográficos
Autor: Arbiol López, Meritxell
Tipo de recurso: tesis de maestría
Fecha de publicación:2023
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/398979
Acceso en línea:https://hdl.handle.net/2117/398979
Access Level:acceso embargado
Palabra clave:Data transmission systems
Information visualization
Data warehousing
Extracció de dades
Transformació de dades
Carrega de dades
Anàlisi Descriptiu
Anàlisi Predictiu
Data Warehouse
Data Mart
Visualització de dades
Power BI
Pentaho
PostgreSQL
Python.
Data extraction
Data transformation
Data load
Descriptive Analysis
Predictive Analysis
Data Visualization
Dades--Transmissió
Visualització de la informació
Gestor de dades
CampusLab
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació
Descripción
Sumario:The project implements from scratch the whole process of data extraction, transformation and loading to perform a set of descriptive and predictive analyses that will be visualized in a report with several graphics. The data used in this study contains information from the UPC related to the users accessing each UPC resource. Once the entire infrastructure is created through which the data from different sources passes, the client has access to a report with several pages, where there are a series of visualizations that are updated in real time so that it is simple, easy to understand and intuitive to interact with the report and obtain the desired information for the client.