Competitive Deep Reinforcement Learning over a Pokémon Battling Simulator

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2020

Autores

David Simões (Autor) Outra; Simão Reis (Autor) Outra; Nuno Lau (Autor) Outra; Luís Paulo Reis (Autor) FEUP

Ata de Conferência Internacional

Título: 2020 IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2020, Ponta Delgada, Portugal, April 15-17, 2020

Páginas: 40-45

2020 IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2020

15 April 2020 through 16 April 2020

Indexação

ISI Web of Knowledge - 0 Citações

ISI Web of Science

Scopus - 2 Citações

Outras Informações

ID Authenticus: P-00S-9PD

DOI: 10.1109/ICARSC49921.2020.9096092

Abstract (EN): Pokémon is one of the most popular video games in the world, and recent interest has appeared in Pokémon battling as a testbed for AI challenges. This is due to Pokémon battling showing interesting properties which contrast with current AI challenges over other video games. To this end, we implement a Pokémon Battle Environment, which preserves many of the core elements of Pokémon battling, and allows researchers to test isolated learning objectives. Our approach focuses on type advantage in Pokémon battles and on the advantages of delayed rewards through switching, which is considered core strategies for any Pokémon battle. As a competitive multi-agent environment, it has a partially-observable, high-dimensional, and continuous state-space, adheres to the Gym de facto standard reinforcement learning interface, and is performance-oriented, achieving thousands of interactions per second in commodity hardware. We determine whether deep competitive reinforcement learning algorithms, WPLθ and GIGAθ, can learn successful policies in this environment. Both converge to rational and effective strategies, and GIGAθ shows faster convergence, obtaining a 100% win-rate in a disadvantageous test scenario. © 2020 IEEE.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 6