Competitive Deep Reinforcement Learning over a Pokémon Battling Simulator

• Type: Article in International Conference Proceedings Book
• Date: 2020

Authors

David Simões (Author) Other; Simão Reis (Author) Other; Nuno Lau (Author) Other; Luís Paulo Reis (Author) FEUP

Conference proceedings International

Title: 2020 IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2020, Ponta Delgada, Portugal, April 15-17, 2020

Pages: 40-45

2020 IEEE International Conference on Autonomous Robot Systems and Competitions, ICARSC 2020

15 April 2020 through 16 April 2020

Indexing

ISI Web of Knowledge - 0 Citations

ISI Web of Science

Scopus - 2 Citations

Other information

Authenticus ID: P-00S-9PD

DOI: 10.1109/ICARSC49921.2020.9096092

Abstract (EN): Pokémon is one of the most popular video games in the world, and recent interest has appeared in Pokémon battling as a testbed for AI challenges. This is due to Pokémon battling showing interesting properties which contrast with current AI challenges over other video games. To this end, we implement a Pokémon Battle Environment, which preserves many of the core elements of Pokémon battling, and allows researchers to test isolated learning objectives. Our approach focuses on type advantage in Pokémon battles and on the advantages of delayed rewards through switching, which is considered core strategies for any Pokémon battle. As a competitive multi-agent environment, it has a partially-observable, high-dimensional, and continuous state-space, adheres to the Gym de facto standard reinforcement learning interface, and is performance-oriented, achieving thousands of interactions per second in commodity hardware. We determine whether deep competitive reinforcement learning algorithms, WPLθ and GIGAθ, can learn successful policies in this environment. Both converge to rational and effective strategies, and GIGAθ shows faster convergence, obtaining a 100% win-rate in a disadvantageous test scenario. © 2020 IEEE.

Language: English

Type (Professor's evaluation): Scientific

No. of pages: 6