A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks

​© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to...

Descripción completa

Detalles Bibliográficos
Autores: Kibalya, Godfrey Mirondo|||0000-0002-7053-3756, Serrat Fernández, Juan|||0000-0002-4551-9880, Gorricho Moreno, Juan Luis|||0000-0002-6280-1546, Zhang, Peiying
Tipo de recurso: artículo
Fecha de publicación:2022
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/381198
Acceso en línea:https://hdl.handle.net/2117/381198
https://dx.doi.org/10.1109/TNSM.2022.3175910
Access Level:acceso abierto
Palabra clave:Computer network architectures
VNF Sharing
Reinforcement Learning
Virtual Network Function chaining placement
Resource allocation
Ordinadors, Xarxes d'--Arquitectures
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Telemàtica i xarxes d'ordinadors
id ES_ded65a24ea799d3ded80679713046faa
oai_identifier_str oai:upcommons.upc.edu:2117/381198
network_acronym_str ES
network_name_str España
repository_id_str
spelling A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networksKibalya, Godfrey Mirondo|||0000-0002-7053-3756Serrat Fernández, Juan|||0000-0002-4551-9880Gorricho Moreno, Juan Luis|||0000-0002-6280-1546Zhang, PeiyingComputer network architecturesVNF SharingReinforcement LearningVirtual Network Function chaining placementResource allocationOrdinadors, Xarxes d'--ArquitecturesÀrees temàtiques de la UPC::Enginyeria de la telecomunicació::Telemàtica i xarxes d'ordinadors​© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Cognizant of the ease with which softwarized functions can be dynamically scaled according to real time resource requirements, and the fact that multiple services can have common VNFs in their chaining, this paper tackles the problem of cost effective deployment of online services from the perspective of sharing their VNF instances. First, we formally formulate the deployment problem under VNFs sharing. Secondly, given the NP-hard nature of the above problem, we propose a reinforcement learning (RL) algorithm capable of making intelligent placement decisions while considering multiple conflicting costs. Costs of transmission, VNF instantiation or energy consumption, among others. Thanks to the intelligence of the RL algorithm, simulation results show that the performance of the proposed algorithm is within a 14% margin and similar to an optimal solution in terms of request provisioning cost and acceptance ratio, respectively. Moreover, the algorithm results in more than a 20% and a 70% improvement in terms of request deployment cost and time compared to a state-of-the-art algorithm, and up to more than a 40% improvement in terms of cost compared to an algorithm that greedily minimizes the transmission or VNF activation costs.20222022-05-1720232023-01-26journal articlehttp://purl.org/coar/resource_type/c_6501AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/2117/381198https://dx.doi.org/10.1109/TNSM.2022.3175910reponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/3811982026-05-27T15:37:01Z
dc.title.none.fl_str_mv A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks
title A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks
spellingShingle A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks
Kibalya, Godfrey Mirondo|||0000-0002-7053-3756
Computer network architectures
VNF Sharing
Reinforcement Learning
Virtual Network Function chaining placement
Resource allocation
Ordinadors, Xarxes d'--Arquitectures
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Telemàtica i xarxes d'ordinadors
title_short A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks
title_full A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks
title_fullStr A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks
title_full_unstemmed A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks
title_sort A reinforcement learning approach for Virtual Network Function Chaining and sharing in softwarized networks
dc.creator.none.fl_str_mv Kibalya, Godfrey Mirondo|||0000-0002-7053-3756
Serrat Fernández, Juan|||0000-0002-4551-9880
Gorricho Moreno, Juan Luis|||0000-0002-6280-1546
Zhang, Peiying
author Kibalya, Godfrey Mirondo|||0000-0002-7053-3756
author_facet Kibalya, Godfrey Mirondo|||0000-0002-7053-3756
Serrat Fernández, Juan|||0000-0002-4551-9880
Gorricho Moreno, Juan Luis|||0000-0002-6280-1546
Zhang, Peiying
author_role author
author2 Serrat Fernández, Juan|||0000-0002-4551-9880
Gorricho Moreno, Juan Luis|||0000-0002-6280-1546
Zhang, Peiying
author2_role author
author
author
dc.subject.none.fl_str_mv Computer network architectures
VNF Sharing
Reinforcement Learning
Virtual Network Function chaining placement
Resource allocation
Ordinadors, Xarxes d'--Arquitectures
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Telemàtica i xarxes d'ordinadors
topic Computer network architectures
VNF Sharing
Reinforcement Learning
Virtual Network Function chaining placement
Resource allocation
Ordinadors, Xarxes d'--Arquitectures
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Telemàtica i xarxes d'ordinadors
description ​© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
publishDate 2022
dc.date.none.fl_str_mv 2022
2022-05-17
2023
2023-01-26
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
AM
http://purl.org/coar/version/c_ab4af688f83e57aa
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/2117/381198
https://dx.doi.org/10.1109/TNSM.2022.3175910
url https://hdl.handle.net/2117/381198
https://dx.doi.org/10.1109/TNSM.2022.3175910
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:UPCommons. Portal del coneixement obert de la UPC
instname:Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
reponame_str UPCommons. Portal del coneixement obert de la UPC
collection UPCommons. Portal del coneixement obert de la UPC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869422010621231104
score 15,301603