On the design and optimization of heterogeneous distributed storage systems

Over the last decade, users’ storage demands have been growing exponentially year over year. Besides demanding more storage capacity and more data reliability, today users also demand the possibility to access their data from any location and from any device. These new needs encourage users to move...

Descripción completa

Detalles Bibliográficos
Autor: Pàmies Juárez, Lluís
Tipo de recurso: tesis doctoral
Estado:Versión publicada
Fecha de publicación:2011
País:España
Institución:Universitat Rovira i virgili (URV)
Repositorio:Repositori Institucional de la Universitat Rovira i Virgili
OAI Identifier:oai:urv.cat:TDX:971
Acceso en línea:https://hdl.handle.net/20.500.11797/TDX971
http://hdl.handle.net/10803/38881
Access Level:acceso abierto
Palabra clave:004 - Informàtica
Descripción
Sumario:Over the last decade, users’ storage demands have been growing exponentially year over year. Besides demanding more storage capacity and more data reliability, today users also demand the possibility to access their data from any location and from any device. These new needs encourage users to move their personal data (e.g., E-mails, documents, pictures, etc.) to online storage services such as Gmail, Facebook, Flickr or Dropbox. Unfortunately, these online storage services are built upon expensive large datacenters that only a few big enterprises can afford. To reduce the costs of these large datacenters, a new wave of online storage services has recently emerged integrating storage resources from different small datacenters, or even integrating user storage resources into the provider’s storage infrastructure. However, the storage resources that compose these new storage infrastructures are highly heterogeneous, which poses a challenging problem to storage systems designers: How to design reliable and efficient distributed storage systems over heterogeneous storage infrastructures? This thesis provides an analysis of the main problems that arise when one aims to answer this question. Besides that, this thesis provides different tools to optimize the design of heterogeneous distributed storage systems. The contribution of this thesis is threefold: First, we provide a novel framework to analyze the effects that data redundancy has on the storage and communication costs of distributed storage systems. Given a generic redundancy scheme, the presented framework can predict the average storage costs and the average communication costs of a storage system deployed over a specific storage infrastructure. Second, we analyze the impacts that data redundancy has on data avai