A smart and novel approach for managing incast and in-network congestion through adaptive routing

High-Performance Computing and Datacenter systems, with numerous endnodes, demand an efficient interconnection network to prevent performance bottlenecks. Fat-Tree topologies are preferred for their high bisection bandwidth and multiple shortest-path routes. While existing adaptive routing excels in...

Descripción completa

Detalles Bibliográficos
Autores: Rocher González, José Manuel, Escudero Sahuquillo, Jesús, García García, Pedro Javier, Quiles Flor, Francisco José, Duato Marín, José
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Universidad de Castilla-La Mancha
Repositorio:RUIdeRA. Repositorio Institucional de la UCLM
OAI Identifier:oai:ruidera.uclm.es:10578/41516
Acceso en línea:https://hdl.handle.net/10578/41516
Access Level:acceso abierto
Palabra clave:High-performance computing
Datacenters
Interconnection networks
Congestion management
Adaptive routing
Descripción
Sumario:High-Performance Computing and Datacenter systems, with numerous endnodes, demand an efficient interconnection network to prevent performance bottlenecks. Fat-Tree topologies are preferred for their high bisection bandwidth and multiple shortest-path routes. While existing adaptive routing excels in light or in-network congestion, it struggles with incast congestion. This paper proposes a new technique, called Congestion-Aware Adaptive Routing (SCAR), which addresses both in-network and incast congestion. SCAR limits adaptivity for incast congestion, using deterministic routing, while employing adaptive routing for non-congesting flows. It also resolves in-network congestion by routing traffic flows through alternative routes. Simulation experiments on large Fat-Trees using synthetic and trace-based traffic patterns modeling realistic applications demonstrate SCAR’s immediate reaction on mitigating in-network congestion, and a reasonable delay during incast situations, while other state-of-the-art solutions are not able to cope with incast and in-network situations at the same time.