Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning

Safety is the primary concern when it comes to air traffic. In-flight safety between Unmanned Aircraft Vehicles (UAVs) is ensured through pairwise separation minima, utilizing conflict detection and resolution methods. Existing methods mainly deal with pairwise conflicts, however, due to an expected...

Descripción completa

Detalles Bibliográficos
Autores: Isufaj, Ralvi|||0000-0003-0839-3235, Omeri, Marsel|||0000-0002-4547-3202, Piera, Miquel Àngel|||0000-0002-7227-7944
Tipo de recurso: artículo
Fecha de publicación:2022
País:España
Institución:Universitat Autònoma de Barcelona
Repositorio:Dipòsit Digital de Documents de la UAB
Idioma:inglés
OAI Identifier:oai:ddd.uab.cat:255901
Acceso en línea:https://ddd.uab.cat/record/255901
https://dx.doi.org/urn:doi:10.3390/app12020610
Access Level:acceso abierto
Palabra clave:UTM
UAS
Machine learning
Artificial intelligence
Multi-UAS cooperative control
Multiagent reinforcement learning
Descripción
Sumario:Safety is the primary concern when it comes to air traffic. In-flight safety between Unmanned Aircraft Vehicles (UAVs) is ensured through pairwise separation minima, utilizing conflict detection and resolution methods. Existing methods mainly deal with pairwise conflicts, however, due to an expected increase in traffic density, encounters with more than two UAVs are likely to happen. In this paper, we model multi-UAV conflict resolution as a multiagent reinforcement learning problem. We implement an algorithm based on graph neural networks where cooperative agents can communicate to jointly generate resolution maneuvers. The model is evaluated in scenarios with 3 and 4 present agents. Results show that agents are able to successfully solve the multi-UAV conflicts through a cooperative strategy.