What to consider for applying backfilling on non-dedicated environments

The resource utilization level in open laboratories of several universities has been shown to be very low. Our aim is to take advantage of those idle resources for parallel computation without disturbing the local load. In order to provide a system that lets us execute parallel applications in such...

Descripción completa

Detalles Bibliográficos
Autores: Hanzich, Mauricio, Giné, Francesc, Hernández Budé, Porfidio, Solsona Tehàs, Francesc, Luque, Emilio
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2005
País:España
Institución:Universitat de Lleida (UdL)
Repositorio:Repositori Obert UdL
OAI Identifier:oai:repositori.udl.cat:10459.1/41499
Acceso en línea:http://hdl.handle.net/10459.1/41499
Access Level:acceso abierto
Palabra clave:Space-Sharing
Non-dedicated clusters
Backfilling
Coscheduling
Processament en paral·lel (Ordinadors)
Processament distribuït de dades
Cluster, Anàlisi de
Descripción
Sumario:The resource utilization level in open laboratories of several universities has been shown to be very low. Our aim is to take advantage of those idle resources for parallel computation without disturbing the local load. In order to provide a system that lets us execute parallel applications in such a non-dedicated cluster, we use an integral scheduling system that considers both Space and Time sharing concerns. For dealing with the Time Sharing (TS) aspect, we use a technique based on the communication-driven coscheduling principle. This kind of TS system has some implications on the Space Sharing (SS) system, that force us to modify the way job scheduling is traditionally done. In this paper, we analyze the relation between the TS and the SS systems in a non-dedicated cluster. As a consequence of this analysis, we propose a new technique, termed 3DBackfilling. This proposal implements the well known SS technique of backfilling, but applied to an environment with a MultiProgramming Level (MPL) of the parallel applications that is greater than one. Besides, 3DBackfilling considers the requirements of the local workload running on each node. Our proposal was evaluated in a PVM/MPI Linux cluster, and it was compared with several more traditional SS policies applied to non-dedicated environments.