Automatic Generation of a Sub-optimal Agent Population with Learning

• Tipo: Artigo em Livro de Atas de Conferência Internacional
• Data: 2019

Autores

Simão Reis (Autor) Outra; Luís Paulo Reis (Autor) FEUP; Nuno Lau (Autor) Outra

Ata de Conferência Internacional

Título: Advances in Intelligent Systems and Computing

Páginas: 65-74

World Conference on Information Systems and Technologies, WorldCIST 2019

16 April 2019 through 19 April 2019

Outras Informações

ID Authenticus: P-00R-ZYR

DOI: 10.1007/978-3-030-16184-2_7

Abstract (EN): Most modern solutions for video game balancing are directed towards specific games. We are currently researching general methods for automatic multiplayer game balancing. The problem is modeled as a meta-game, where game-play change the rules from another game. This way, a Machine Learning agent that learns to play a meta-game, learns how to change a base game following some balancing metric. But an issue resides in the generation of high volume of game-play training data, was agents of different skill compete against each other. For this end we propose the automatic generation of a population of surrogate agents by learning sampling. In Reinforcement Learning an agent learns in a trial error fashion where it improves gradually its policy, the mapping from world state to action to perform. This means that in each successful evolutionary step an agent follows a sub-optimal strategy, or eventually the optimal strategy. We store the agent policy at the end of each training episode. The process is evaluated in simple environments with distinct properties. Quality of the generated population is evaluated by the diversity of the difficulty the agents have in solving their tasks. © Springer Nature Switzerland AG 2019.

Idioma: Inglês

Tipo (Avaliação Docente): Científica

Nº de páginas: 10