Multi-objective scheduling of Scientific Workflows in multisite clouds

Clouds appear as appropriate infrastructures for executing Scientific Workflows (SWfs). A cloud is typically made of several sites (or data centers), each with its own resources and data. Thus, it becomes important to be able to execute some SWfs at more than one cloud site because of the geographic...

ver descrição completa

Detalhes bibliográficos
Autores: Liu, Ji, Pacitti, Esther, Valduriez, Patrick, Oliveira, Daniel de, Mattoso, Marta
Formato: artículo
Fecha de publicación:2016
País:España
Recursos:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/95941
Acesso em linha:https://hdl.handle.net/2117/95941
https://dx.doi.org/10.1016/j.future.2016.04.014
Access Level:acceso abierto
Palavra-chave:Workflow computing systems
Parallel processing (Electronic computers)
Algorithms and architectures for advanced scientific computing
Scientific workflow
Scientific workflow management system
Multi-objective scheduling
Parallel execution
Multisite cloud
Algorismes computacionals
Cicle de treball
Processament en paral·lel (Ordinadors)
Àrees temàtiques de la UPC::Enginyeria electrònica
Descrição
Resumo:Clouds appear as appropriate infrastructures for executing Scientific Workflows (SWfs). A cloud is typically made of several sites (or data centers), each with its own resources and data. Thus, it becomes important to be able to execute some SWfs at more than one cloud site because of the geographical distribution of data or available resources among different cloud sites. Therefore, a major problem is how to execute a SWf in a multisite cloud, while reducing execution time and monetary costs. In this paper, we propose a general solution based on multi-objective scheduling in order to execute SWfs in a multisite cloud. The solution consists of a multi-objective cost model including execution time and monetary costs, a Single Site Virtual Machine (VM) Provisioning approach (SSVP) and ActGreedy, a multisite scheduling approach. We present an experimental evaluation, based on the execution of the SciEvol SWf in Microsoft Azure cloud. The results reveal that our scheduling approach significantly outperforms two adapted baseline algorithms (which we propose by adapting two existing algorithms) and the scheduling time is reasonable compared with genetic and brute-force algorithms. The results also show that our cost model is accurate and that SSVP can generate better VM provisioning plans compared with an existing approach.