Autonomous underwater vehicle control using reinforcement learning policy search methods

Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. T...

Descripción completa

Detalles Bibliográficos
Autores: El-Fakdi Sencianes, Andrés, Carreras Pérez, Marc, Palomeras Rovira, Narcís, Ridao Rodríguez, Pere
Tipo de recurso: artículo
Fecha de publicación:2005
País:España
Institución:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repositorio:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10256/2220
Acceso en línea:http://hdl.handle.net/10256/2220
Access Level:acceso abierto
Palabra clave:Aprenentatge per reforç
Robots autònoms -- Sistemes de control
Vehicles submergibles -- Sistemes de control
Autonomous robots -- Control systems
Reinforcement learning
Submersibles -- Control systems
Descripción
Sumario:Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. This paper proposes a high-level control system for solving the action selection problem of an autonomous robot. The system is characterized by the use of reinforcement learning direct policy search methods (RLDPS) for learning the internal state/action mapping of some behaviors. We demonstrate its feasibility with simulated experiments using the model of our underwater robot URIS in a target following task