Using AWS EC2 as Test-Bed infrastructure in the I/O system configuration for HPC applications

In recent years, the use of public cloud platforms as infrastructure has been gaining popularity in many scientific areas and High Performance Computing (HPC) is no exception. These kinds of platforms can be used by system administrators as Test-Bed systems for evaluating and detecting performance i...

Descripción completa

Detalles Bibliográficos
Autores: Gómez Sánchez, Pilar|||0000-0002-5993-7645, Encinas, Diego|||0000-0002-6948-9786, Panadero, Javier|||0000-0002-3793-3328, Bezerra, Aprigio, Méndez, Sandra|||0000-0002-5793-1928, Naiouf, Marcelo|||0000-0001-9127-3212, De Giusti, Armando|||0000-0002-6459-3592, Rexachs, Dolores|||0000-0001-5500-850X, Luque, Emilio|||0000-0002-2884-3232
Tipo de recurso: artículo
Fecha de publicación:2016
País:España
Institución:Universitat Autònoma de Barcelona
Repositorio:Dipòsit Digital de Documents de la UAB
Idioma:inglés
OAI Identifier:oai:ddd.uab.cat:168455
Acceso en línea:https://ddd.uab.cat/record/168455
Access Level:acceso abierto
Palabra clave:Cloud Computing
Parallel File System
PVFS2
MPI applications
Descripción
Sumario:In recent years, the use of public cloud platforms as infrastructure has been gaining popularity in many scientific areas and High Performance Computing (HPC) is no exception. These kinds of platforms can be used by system administrators as Test-Bed systems for evaluating and detecting performance inefficiencies in the I/O subsystem, and for taking decisions about the configuration parameters that have influence on the performance of an application, without compromising the performance of the production HPC system. In this paper, we propose a methodology to evaluate parallel applications by using virtual clusters as a test system. Our experimental validation indicates that virtual clusters are a quick and easy solution for system administrators, for analyzing the impact of the I/O system on the I/O kernels of the parallel applications and for taking performance decisions in a controlled environment.