Revisiting Deep Attention Recurrent Networks

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2023

Autores

Duarte, FF (Autor) Outra; Lau, N (Autor) Outra; Pereira, A (Autor) Outra; reis, lp (Autor) FEUP

Ata de Conferência Internacional

Título: PROGRESS IN ARTIFICIAL INTELLIGENCE, EPIA 2023, PT I

Páginas: 121-132

22nd EPIA Conference on Artificial Intelligence (EPIA)

Azores, PORTUGAL, SEP 05-08, 2023

Indexação

ISI Web of Knowledge - 0 Citações

Scopus - 0 Citações

Outras Informações

ID Authenticus: P-00Z-KYJ

DOI: 10.1007/978-3-031-49008-8_10

Abstract (EN): Attention-based agents have had much success in many areas of Artificial Intelligence, such as Deep Reinforcement Learning. This work revisits two such architectures, namely, Deep Attention Recurrent Q-Networks (DARQNs) and Soft Top-Down Spatial Attention (STDA) and explores the similarities between them. More specifically, this work tries to improve the performance of the DARQN architecture by leveraging elements proposed by the STDA architecture, such as the formulation of its attention function which also includes the incorporation of a spatial basis into its computation. The implementation tested, denoted Deep Attention Recurrent Actor-Critic (DARAC), uses the A2C learning algorithm. The results obtained seem to suggest that the performance of DARAC can be improved by the incorporation of some of the techniques proposed in STDA. Overall, DARAC showed competitive results when compared to STDA and slightly better in some of the experiments performed. The Atari 2600 video game benchmark was the testbed used to perform and validate all the experiments.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 12