Automated database design for document stores with multicriteria optimization

Document stores have gained popularity among NoSQL systems mainly due to the semi-structured data storage structure and the enhanced query capabilities. The database design in document stores expands beyond the first normal form by encouraging de-normalization through nesting. This hinders the proce...

Full description

Bibliographic Details
Authors: Hewasinghage, Moditha Lakshan Dharmasir, Nadal Francesch, Sergi|||0000-0002-8565-952X, Abelló Gamazo, Alberto|||0000-0002-3223-2186, Zimányi, Esteban
Format: article
Publication Date:2023
Country:España
Institution:Universitat Politècnica de Catalunya (UPC)
Repository:UPCommons. Portal del coneixement obert de la UPC
Language:English
OAI Identifier:oai:upcommons.upc.edu:2117/387548
Online Access:https://hdl.handle.net/2117/387548
https://dx.doi.org/10.1007/s10115-023-01828-3
Access Level:Open access
Keyword:Database design
Document store
Optimization
Bases de dades -- Disseny
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Bases de dades
id ES_21b3e7a31f4e580a2785b2a4983dbd5d
oai_identifier_str oai:upcommons.upc.edu:2117/387548
network_acronym_str ES
network_name_str España
repository_id_str
spelling Automated database design for document stores with multicriteria optimizationHewasinghage, Moditha Lakshan DharmasirNadal Francesch, Sergi|||0000-0002-8565-952XAbelló Gamazo, Alberto|||0000-0002-3223-2186Zimányi, EstebanDatabase designDocument storeOptimizationBases de dades -- DissenyÀrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Bases de dadesDocument stores have gained popularity among NoSQL systems mainly due to the semi-structured data storage structure and the enhanced query capabilities. The database design in document stores expands beyond the first normal form by encouraging de-normalization through nesting. This hinders the process, as the number of alternatives grows exponentially with multiple choices in nesting (including different levels) and referencing (including the direction of the reference). Due to this complexity, document store data design is mostly carried out in trial-and-error or ad-hoc rule-based approaches. However, the choices affect multiple, often conflicting, aspects such as query performance, storage space, and complexity of the documents. To overcome these issues, in this paper, we apply multicriteria optimization. Our approach is driven by a query workload and a set of optimization objectives. First, we formalize a canonical model to represent alternative designs and introduce an algebra of transformations that can systematically modify a design. Then, using these transformations, we implement a local search algorithm driven by a loss function that can propose near-optimal designs with high probability. Finally, we compare our prototype against an existing document store data design solution purely driven by query cost, where our proposed designs have better performance and are more compact with less redundancy.Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This research has been funded by the European Commission through the Erasmus Mundus Joint Doctorate "Information Technologies for Business Intelligence—Doctoral College" (IT4BI-DC). Sergi Nadal is partly supported by the Spanish Ministerio de Ciencia e Innovación, as well as the European Union—NextGenerationEU, under project FJC2020-045809-I / AEI/10.13039/501100011033.Peer ReviewedSpringer20232023-03-1120232023-05-18journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/2117/387548https://dx.doi.org/10.1007/s10115-023-01828-3reponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2Attribution 4.0 Internationalhttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/3875482026-05-27T15:37:01Z
dc.title.none.fl_str_mv Automated database design for document stores with multicriteria optimization
title Automated database design for document stores with multicriteria optimization
spellingShingle Automated database design for document stores with multicriteria optimization
Hewasinghage, Moditha Lakshan Dharmasir
Database design
Document store
Optimization
Bases de dades -- Disseny
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Bases de dades
title_short Automated database design for document stores with multicriteria optimization
title_full Automated database design for document stores with multicriteria optimization
title_fullStr Automated database design for document stores with multicriteria optimization
title_full_unstemmed Automated database design for document stores with multicriteria optimization
title_sort Automated database design for document stores with multicriteria optimization
dc.creator.none.fl_str_mv Hewasinghage, Moditha Lakshan Dharmasir
Nadal Francesch, Sergi|||0000-0002-8565-952X
Abelló Gamazo, Alberto|||0000-0002-3223-2186
Zimányi, Esteban
author Hewasinghage, Moditha Lakshan Dharmasir
author_facet Hewasinghage, Moditha Lakshan Dharmasir
Nadal Francesch, Sergi|||0000-0002-8565-952X
Abelló Gamazo, Alberto|||0000-0002-3223-2186
Zimányi, Esteban
author_role author
author2 Nadal Francesch, Sergi|||0000-0002-8565-952X
Abelló Gamazo, Alberto|||0000-0002-3223-2186
Zimányi, Esteban
author2_role author
author
author
dc.subject.none.fl_str_mv Database design
Document store
Optimization
Bases de dades -- Disseny
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Bases de dades
topic Database design
Document store
Optimization
Bases de dades -- Disseny
Àrees temàtiques de la UPC::Informàtica::Sistemes d'informació::Bases de dades
description Document stores have gained popularity among NoSQL systems mainly due to the semi-structured data storage structure and the enhanced query capabilities. The database design in document stores expands beyond the first normal form by encouraging de-normalization through nesting. This hinders the process, as the number of alternatives grows exponentially with multiple choices in nesting (including different levels) and referencing (including the direction of the reference). Due to this complexity, document store data design is mostly carried out in trial-and-error or ad-hoc rule-based approaches. However, the choices affect multiple, often conflicting, aspects such as query performance, storage space, and complexity of the documents. To overcome these issues, in this paper, we apply multicriteria optimization. Our approach is driven by a query workload and a set of optimization objectives. First, we formalize a canonical model to represent alternative designs and introduce an algebra of transformations that can systematically modify a design. Then, using these transformations, we implement a local search algorithm driven by a loss function that can propose near-optimal designs with high probability. Finally, we compare our prototype against an existing document store data design solution purely driven by query cost, where our proposed designs have better performance and are more compact with less redundancy.
publishDate 2023
dc.date.none.fl_str_mv 2023
2023-03-11
2023
2023-05-18
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/2117/387548
https://dx.doi.org/10.1007/s10115-023-01828-3
url https://hdl.handle.net/2117/387548
https://dx.doi.org/10.1007/s10115-023-01828-3
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Attribution 4.0 International
http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Springer
publisher.none.fl_str_mv Springer
dc.source.none.fl_str_mv reponame:UPCommons. Portal del coneixement obert de la UPC
instname:Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
reponame_str UPCommons. Portal del coneixement obert de la UPC
collection UPCommons. Portal del coneixement obert de la UPC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869404530574098432
score 15,301603

Similar Items