Enhancing the performance of malleable MPI applications by using performance-aware dynamic reconfiguration

The work in this paper focuses on providing malleability to MPI applications by using a novel performance-aware dynamic reconfiguration technique. This paper describes the design and implementation of Flex-MPI, an MPI library extension which can automatically monitor and predict the performance of a...

Descripción completa

Detalles Bibliográficos
Autores: Martín, Gonzalo, Singh, David E., Marinescu, Maria-Cristina, Carretero, Jesús
Tipo de recurso: artículo
Fecha de publicación:2015
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/86919
Acceso en línea:https://hdl.handle.net/2117/86919
https://dx.doi.org/10.1016/j.parco.2015.04.003
Access Level:acceso abierto
Palabra clave:Distributed computing
Distributed systems
Malleable MPI applications
Performance-aware dynamic Reconfiguration
Computational prediction model
High performance computing
Computació distribuïda
Àrees temàtiques de la UPC::Enginyeria electrònica
Descripción
Sumario:The work in this paper focuses on providing malleability to MPI applications by using a novel performance-aware dynamic reconfiguration technique. This paper describes the design and implementation of Flex-MPI, an MPI library extension which can automatically monitor and predict the performance of applications, balance and redistribute the workload, and reconfigure the application at runtime by changing the number of processes. Unlike existent approaches, our reconfiguring policy is guided by user-defined performance criteria. We focus on iterative SPMD programs, a class of applications with critical mass within the scientific community. Extensive experiments show that Flex-MPI can improve the performance, parallel efficiency, and cost-efficiency of MPI programs with a minimal effort from the programmer.