Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources

[EN] Serverless functions (SFs) and on-demand virtual machines (VMs) are common cloud resources for scientific workflow applications, which are widespread in many fields. SFs are paid by actual running time with higher unit costs and higher resource utilization than VMs which are paid by billing tim...

Descripción completa

Detalles Bibliográficos
Autores: Jinquan Zhang, Li, Xiaoping, Long Chen, Ruiz García, Rubén
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/207946
Acceso en línea:https://riunet.upv.es/handle/10251/207946
Access Level:acceso abierto
Palabra clave:Task analysis
Costs
Cloud computing
Servers
Schedules
Scheduling algorithms
Scheduling
Scientific workflow scheduling
Budget
Serverless function
Critical path
id ES_842973eecac3d7ddccf27fcd5b1b7310
oai_identifier_str oai:riunet.upv.es:10251/207946
network_acronym_str ES
network_name_str España
repository_id_str
spelling Scheduling Workflows With Limited Budget to Cloud Server and Serverless ResourcesJinquan ZhangLi, XiaopingLong ChenRuiz García, RubénTask analysisCostsCloud computingServersSchedulesScheduling algorithmsSchedulingScientific workflow schedulingBudgetServerless functionCritical path[EN] Serverless functions (SFs) and on-demand virtual machines (VMs) are common cloud resources for scientific workflow applications, which are widespread in many fields. SFs are paid by actual running time with higher unit costs and higher resource utilization than VMs which are paid by billing time units. Generally, each application is executed on a limited budget. In this article, we study the challenging cloud workflow scheduling problem with a limited budget to minimize makespan in a hybridization of SFs and on-demand VMs for which the BCWS (Budget Constrained Workflow Scheduling) algorithm is proposed. Methods are developed to determine the task execution order, rent cloud resources and map tasks to resources respectively. Together with initial schedule construction and schedule improvement policies, these procedures are repeatedly applied in BCWS. The proposed algorithm is evaluated by comparing it to existing algorithms for similar problems over a comprehensive set of workflow instances. Experimental results show that the proposed algorithm significantly reduces the makespan with a hybrid configuration of VMs and SFs compared to the server only or the serverless only configurations and outperforms the compared algorithms which are the best existing ones for similar problems.This work was supported in part by the National Key Research and Development Program of China under Grant 2022YFB3305500, in part by the National Natural Science Foundation of China under Grants 62273089, 62102080, and 61832004, in part by Natural Science Foundation of Jiangsu Province under Grant BK20210204, in part by the Fundamental Research Funds for the Central Universities under Grant 2242022R10017, and in part by Collaborative Innovation Center of Wireless Communications Technology.Institute of Electrical and Electronics EngineersNational Natural Science Foundation of ChinaNatural Science Foundation of Jiangsu ProvinceNational Key Research and Development Program of ChinaFundamental Research Funds for the Central UniversitiesRepositorio Institucional de la Universitat Politècnica de València Riunet20242024-07-01journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfapplication/pdfhttps://riunet.upv.es/handle/10251/207946reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valénciainstname:Universitat Politècnica de València (UPV)InglésengNational Natural Science Foundation of China https://doi.org/10.13039/501100001809 62273089National Natural Science Foundation of China https://doi.org/10.13039/501100001809 62102080National Natural Science Foundation of China https://doi.org/10.13039/501100001809 61832004Fundamental Research Funds for the Central Universities Fundamental Research Funds for the Central Universities 2242022R10017Natural Science Foundation of Jiangsu Province Natural Science Foundation of Jiangsu Province BK20210204National Key Research and Development Program of China https://doi.org/10.13039/501100012166 2022YFB3305500open accesshttp://purl.org/coar/access_right/c_abf2Reserva de todos los derechoshttp://rightsstatements.org/vocab/InC/1.0/info:eu-repo/semantics/openAccessoai:riunet.upv.es:10251/2079462026-06-13T07:49:27Z
dc.title.none.fl_str_mv Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources
title Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources
spellingShingle Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources
Jinquan Zhang
Task analysis
Costs
Cloud computing
Servers
Schedules
Scheduling algorithms
Scheduling
Scientific workflow scheduling
Budget
Serverless function
Critical path
title_short Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources
title_full Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources
title_fullStr Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources
title_full_unstemmed Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources
title_sort Scheduling Workflows With Limited Budget to Cloud Server and Serverless Resources
dc.creator.none.fl_str_mv Jinquan Zhang
Li, Xiaoping
Long Chen
Ruiz García, Rubén
author Jinquan Zhang
author_facet Jinquan Zhang
Li, Xiaoping
Long Chen
Ruiz García, Rubén
author_role author
author2 Li, Xiaoping
Long Chen
Ruiz García, Rubén
author2_role author
author
author
dc.contributor.none.fl_str_mv National Natural Science Foundation of China
Natural Science Foundation of Jiangsu Province
National Key Research and Development Program of China
Fundamental Research Funds for the Central Universities
Repositorio Institucional de la Universitat Politècnica de València Riunet
dc.subject.none.fl_str_mv Task analysis
Costs
Cloud computing
Servers
Schedules
Scheduling algorithms
Scheduling
Scientific workflow scheduling
Budget
Serverless function
Critical path
topic Task analysis
Costs
Cloud computing
Servers
Schedules
Scheduling algorithms
Scheduling
Scientific workflow scheduling
Budget
Serverless function
Critical path
description [EN] Serverless functions (SFs) and on-demand virtual machines (VMs) are common cloud resources for scientific workflow applications, which are widespread in many fields. SFs are paid by actual running time with higher unit costs and higher resource utilization than VMs which are paid by billing time units. Generally, each application is executed on a limited budget. In this article, we study the challenging cloud workflow scheduling problem with a limited budget to minimize makespan in a hybridization of SFs and on-demand VMs for which the BCWS (Budget Constrained Workflow Scheduling) algorithm is proposed. Methods are developed to determine the task execution order, rent cloud resources and map tasks to resources respectively. Together with initial schedule construction and schedule improvement policies, these procedures are repeatedly applied in BCWS. The proposed algorithm is evaluated by comparing it to existing algorithms for similar problems over a comprehensive set of workflow instances. Experimental results show that the proposed algorithm significantly reduces the makespan with a hybrid configuration of VMs and SFs compared to the server only or the serverless only configurations and outperforms the compared algorithms which are the best existing ones for similar problems.
publishDate 2024
dc.date.none.fl_str_mv 2024
2024-07-01
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://riunet.upv.es/handle/10251/207946
url https://riunet.upv.es/handle/10251/207946
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.relation.none.fl_str_mv National Natural Science Foundation of China https://doi.org/10.13039/501100001809 62273089
National Natural Science Foundation of China https://doi.org/10.13039/501100001809 62102080
National Natural Science Foundation of China https://doi.org/10.13039/501100001809 61832004
Fundamental Research Funds for the Central Universities Fundamental Research Funds for the Central Universities 2242022R10017
Natural Science Foundation of Jiangsu Province Natural Science Foundation of Jiangsu Province BK20210204
National Key Research and Development Program of China https://doi.org/10.13039/501100012166 2022YFB3305500
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
Reserva de todos los derechos
http://rightsstatements.org/vocab/InC/1.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
application/pdf
dc.publisher.none.fl_str_mv Institute of Electrical and Electronics Engineers
publisher.none.fl_str_mv Institute of Electrical and Electronics Engineers
dc.source.none.fl_str_mv reponame:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
instname:Universitat Politècnica de València (UPV)
instname_str Universitat Politècnica de València (UPV)
reponame_str RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
collection RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869412189159292928
score 15,811543

Similares en LA Referencia