Comparative Study on Curiosity with Attention, Memory and Empowerment

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2025

Autores

Duarte, FF (Autor) Outra; Lau, N (Autor) Outra; Pereira, A (Autor) Outra; reis, lp (Autor) FEUP

Ata de Conferência Internacional

Título: 2025 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Páginas: 92-97

2025 International Conference on Autonomous Robot Systems and Competitions-ICARSC-Annual

Funchal, PORTUGAL, APR 02-03, 2025

Indexação

ISI Web of Knowledge - 0 Citações

Scopus - 0 Citações

Outras Informações

ID Authenticus: P-018-RSS

DOI: 10.1109/icarsc65809.2025.10970179

Abstract (EN): Currently, most Deep Reinforcement Learning agents train their policy via the feedback signal provided by the environment, during the agent-environment interaction loop. This feedback, in the form of a reward signal, is usually task specific and manually hand engineered. However, in many real-world scenarios of interest, it is very hard or even unfeasible to manually craft this reward function. In other cases, the reward signal provided to the agent may be too sparse, hindering the learning process. Curiosity is a research field that aims to address these issues by endowing the agent with an intrinsic reward signal, allowing it to continue to explore its environment even in the absence of an external feedback signal. This work revisits the Intrinsic Curiosity Module, a formulation of curiosity based on the prediction error, and augments it with techniques from other research areas, such as attention and memory. An agent based on empowerment is also used in this comparative study, for completeness. The Atari 2600 videogame benchmark was used to perform and validate all the experiments.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 6