Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems

New challenges to file systems’ metadata performance are imposed by the continuously growing average number of files existing in file systems. The traditional component based lookup approach can become a performance bottleneck for many workloads. An alternative to component-based lookup is the direc...

Descripción completa

Detalles Bibliográficos
Autor: Lensing, Paul Hermann
Tipo de recurso: tesis doctoral
Estado:Versión publicada
Fecha de publicación:2019
País:España
Institución:CBUC, CESCA
Repositorio:TDR. Tesis Doctorales en Red
OAI Identifier:oai:www.tdx.cat:10803/666788
Acceso en línea:http://hdl.handle.net/10803/666788
https://dx.doi.org/10.5821/dissertation-2117-134746
Access Level:acceso abierto
Palabra clave:Àrees temàtiques de la UPC::Informàtica
004
id ES_6c10e87ba880e76cab56b9f683fb2e8a
oai_identifier_str oai:www.tdx.cat:10803/666788
network_acronym_str ES
network_name_str España
repository_id_str
spelling Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systemsLensing, Paul HermannÀrees temàtiques de la UPC::Informàtica004New challenges to file systems’ metadata performance are imposed by the continuously growing average number of files existing in file systems. The traditional component based lookup approach can become a performance bottleneck for many workloads. An alternative to component-based lookup is the direct lookup approach. It uses hash-based metadata placement to enable direct computation of the metadata location and to completely skip component traversal. This thesis evaluates the implications of the direct lookup approach on file system architecture, performance and scalability. It includes an analysis of file system traces focusing on the frequency and characteristics of hierarchical operations. These properties had not been sufficiently explored in existing literature and are fundamental to the direct lookup design. Full direct lookup file systems are implemented and evaluated for both local and distributed scenarios.El rendimiento de los metadatos de los sistemas de ficheros impone nuevos desafíos debido a que el número promedio de ficheros está en constante crecimiento. El enfoque de búsqueda tradicional basado en ir atravesando los diferentes componentes puede convertirse en un cuello de botella de rendimiento para muchas cargas de trabajo. Una alternativa a la búsqueda basada en componentes consiste en la búsqueda directa. Esta búsqueda utiliza la ubicación de metadatos basada en hash para permitir el cálculo directo de la ubicación de los metadatos y omitir así completamente el recorrido de componentes. Esta tesis evalúa las implicaciones del enfoque de búsqueda directa en la arquitectura, el rendimiento y la escalabilidad del sistema de ficheros. Incluye un análisis de las trazas del sistema de ficheros que se centran en la frecuencia y las características de las operaciones jerárquicas. Estas propiedades no han sido suficientemente exploradas en la literatura existente y son fundamentales para el diseño de búsqueda directa. Los sistemas de archivos de búsqueda directa completa se implementan y evalúan para escenarios locales y distribuidos.DOCTORAT EN ARQUITECTURA DE COMPUTADORS (Pla 2012)Universitat Politècnica de CatalunyaCortés, ToniBrinkmann, AndréUniversitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors201920192019info:eu-repo/semantics/doctoralThesisinfo:eu-repo/semantics/publishedVersion154 p.application/pdfapplication/pdfhttp://hdl.handle.net/10803/666788https://dx.doi.org/10.5821/dissertation-2117-134746TDX (Tesis Doctorals en Xarxa)reponame:TDR. Tesis Doctorales en Redinstname:CBUC, CESCAInglésL'accés als continguts d'aquesta tesi queda condicionat a l'acceptació de les condicions d'ús establertes per la següent llicència Creative Commons: http://creativecommons.org/licenses/by/4.0/http://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:www.tdx.cat:10803/6667882026-06-14T12:46:07Z
dc.title.none.fl_str_mv Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems
title Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems
spellingShingle Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems
Lensing, Paul Hermann
Àrees temàtiques de la UPC::Informàtica
004
title_short Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems
title_full Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems
title_fullStr Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems
title_full_unstemmed Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems
title_sort Direct lookup and hash-based metadata placement : impact on architecture, performance and scalability of local and distributed file systems
dc.creator.none.fl_str_mv Lensing, Paul Hermann
author Lensing, Paul Hermann
author_facet Lensing, Paul Hermann
author_role author
dc.contributor.none.fl_str_mv Cortés, Toni
Brinkmann, André
Universitat Politècnica de Catalunya. Departament d'Arquitectura de Computadors
dc.subject.none.fl_str_mv Àrees temàtiques de la UPC::Informàtica
004
topic Àrees temàtiques de la UPC::Informàtica
004
description New challenges to file systems’ metadata performance are imposed by the continuously growing average number of files existing in file systems. The traditional component based lookup approach can become a performance bottleneck for many workloads. An alternative to component-based lookup is the direct lookup approach. It uses hash-based metadata placement to enable direct computation of the metadata location and to completely skip component traversal. This thesis evaluates the implications of the direct lookup approach on file system architecture, performance and scalability. It includes an analysis of file system traces focusing on the frequency and characteristics of hierarchical operations. These properties had not been sufficiently explored in existing literature and are fundamental to the direct lookup design. Full direct lookup file systems are implemented and evaluated for both local and distributed scenarios.
publishDate 2019
dc.date.none.fl_str_mv 2019
2019
2019
dc.type.none.fl_str_mv info:eu-repo/semantics/doctoralThesis
info:eu-repo/semantics/publishedVersion
format doctoralThesis
status_str publishedVersion
dc.identifier.none.fl_str_mv http://hdl.handle.net/10803/666788
https://dx.doi.org/10.5821/dissertation-2117-134746
url http://hdl.handle.net/10803/666788
https://dx.doi.org/10.5821/dissertation-2117-134746
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.rights.none.fl_str_mv http://creativecommons.org/licenses/by/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 154 p.
application/pdf
application/pdf
dc.publisher.none.fl_str_mv Universitat Politècnica de Catalunya
publisher.none.fl_str_mv Universitat Politècnica de Catalunya
dc.source.none.fl_str_mv TDX (Tesis Doctorals en Xarxa)
reponame:TDR. Tesis Doctorales en Red
instname:CBUC, CESCA
instname_str CBUC, CESCA
reponame_str TDR. Tesis Doctorales en Red
collection TDR. Tesis Doctorales en Red
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869410242021818368
score 15,300719

Similares en LA Referencia