Comparative Study on Curiosity with Attention, Memory and Empowerment

• Type: Article in International Conference Proceedings Book
• Date: 2025

Authors

Duarte, FF (Author) Other; Lau, N (Author) Other; Pereira, A (Author) Other; reis, lp (Author) FEUP

Conference proceedings International

Title: 2025 IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS, ICARSC

Pages: 92-97

2025 International Conference on Autonomous Robot Systems and Competitions-ICARSC-Annual

Funchal, PORTUGAL, APR 02-03, 2025

Indexing

ISI Web of Knowledge - 0 Citations

Scopus - 0 Citations

Other information

Authenticus ID: P-018-RSS

DOI: 10.1109/icarsc65809.2025.10970179

Abstract (EN): Currently, most Deep Reinforcement Learning agents train their policy via the feedback signal provided by the environment, during the agent-environment interaction loop. This feedback, in the form of a reward signal, is usually task specific and manually hand engineered. However, in many real-world scenarios of interest, it is very hard or even unfeasible to manually craft this reward function. In other cases, the reward signal provided to the agent may be too sparse, hindering the learning process. Curiosity is a research field that aims to address these issues by endowing the agent with an intrinsic reward signal, allowing it to continue to explore its environment even in the absence of an external feedback signal. This work revisits the Intrinsic Curiosity Module, a formulation of curiosity based on the prediction error, and augments it with techniques from other research areas, such as attention and memory. An agent based on empowerment is also used in this comparative study, for completeness. The Atari 2600 videogame benchmark was used to perform and validate all the experiments.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 6