Locality-aware Policies to Improve JobScheduling on 3D Tori

This paper studies the influence that contiguous job placement has on the performance of schedulers for large-scale computing systems. In contrast with non-contiguous strategies, contiguous partitioning enables the exploitation of communication locality in applications, and also reduces inter-applic...

Descripción completa

Detalles Bibliográficos
Autores: Pascual Saiz, José Antonio, Miguel Alonso, José, Lozano Alonso, José Antonio
Tipo de recurso: artículo
Fecha de publicación:2014
País:España
Institución:Universidad del País Vasco
Repositorio:Addi. Archivo Digital para la Docencia y la Investigación
OAI Identifier:oai:addi.ehu.eus:10810/71567
Acceso en línea:http://hdl.handle.net/10810/71567
Access Level:acceso abierto
Palabra clave:scheduling
contiguous partitioning
task mapping
locality-aware policies
Descripción
Sumario:This paper studies the influence that contiguous job placement has on the performance of schedulers for large-scale computing systems. In contrast with non-contiguous strategies, contiguous partitioning enables the exploitation of communication locality in applications, and also reduces inter-application interference. However, contiguous partitioning increases scheduling times and system fragmentation, degrading system utilization. We propose and evaluate several strategies to select contiguous partitions to allocate incoming jobs. These strategies are used in combination with different mapping mechanisms to perform the task-to-node assignment in order to further reduce application run times. A simulation-based study has been carried out, using a collection of synthetic applications performing common communication patterns. Results show that the exploitation of communication locality by means of a correct partitioning–mapping results in an effective reduction of application run times, and the gains achieved more than compensate the scheduling inefficiency, therefore resulting in better overall system performance.