Study on LSTM and ConvLSTM Memory-Based Deep Reinforcement Learning

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2024

Autores

Duarte, FF (Autor) Outra; Lau, N (Autor) Outra; Pereira, A (Autor) Outra; reis, lp (Autor) FEUP

Ata de Conferência Internacional

Título: AGENTS AND ARTIFICIAL INTELLIGENCE, ICAART 2023

Páginas: 223-243

15th International Conference on Agents and Artificial Intelligence (ICAART)

Lisbon, PORTUGAL, FEB 22-24, 2023

Indexação

ISI Web of Knowledge - 0 Citações

Scopus - 1 Citação

Outras Informações

ID Authenticus: P-010-9GE

DOI: 10.1007/978-3-031-55326-4_11

Abstract (EN): Memory-based Deep Reinforcement Learning (DRL) has been successfully applied to solve vision-based control tasks from high-dimensional sensory data. While most of this work leverages the Long Short-Term Memory (LSTM) as the memory module of the agent, recent developments have revisited and extended the original formulation of the LSTM. Some of these developments include the ConvLSTM, a convolutional-based implementation of the LSTM, the MDN-RNN, the combination of a Mixture Density Network with an LSTM and the GridLSTM, a multidimensional grid of LSTM cells. It seems however unclear how these different memory modules compare to each other in terms of agent performance, when applied in the context of DRL. This work aims to perform a comparative study of several memory-based DRL agents, based on the LSTM, ConvLSTM, MDN-RNN and GridLSTM memory modules. The results obtained seem to support the claim that in some cases these more recent memory modules can improve the performance of the agent, to varying degrees, when compared to a baseline agent based on an LSTM. The experimental results were validated in the Atari 2600 videogame platform.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 21