Reinforcement learning based robot navigation using illegal actions for autonomous docking of surface vehicles in unknown environments

• Tipo: Artigo em Revista Científica Internacional
• Data: 2024

Autores

Pereira, MI (Autor) Outra; Pinto, AM (Autor) FEUP

Revista

Título: Engineering Applications of Artificial Intelligence

Vol. 133

ISSN: 0952-1976

Editora: Elsevier

Indexação

ISI Web of Knowledge - 0 Citações

Scopus - 0 Citações

Outras Informações

ID Authenticus: P-010-C65

DOI: 10.1016/j.engappai.2024.108506

Abstract (EN): Autonomous Surface Vehicles (ASVs) are bound to play a fundamental role in the maintenance of offshore wind farms. Robust navigation for inspection vehicles should take into account the operation of docking within a harbouring structure, which is a critical and still unexplored maneuver. This work proposes an end-to-end docking approach for ASVs, based on Reinforcement Learning (RL), which teaches an agent to tackle collision- free navigation towards a target pose that allows the berthing of the vessel. The developed research presents a methodology that introduces the concept of illegal actions to facilitate the vessel's exploration during the learning process. This method improves the adopted Actor-Critic (AC) framework by accelerating the agent's optimization by approximately 38.02%. A set of comprehensive experiments demonstrate the accuracy and robustness of the presented method in scenarios with simulated environmental constraints (Beaufort Scale and Douglas Sea Scale), and a diversity of docking structures. Validation with two different real ASVs in both controlled and real environments demonstrates the ability of this method to enable safe docking maneuvers without prior knowledge of the scenario.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 20