Discovering Multimodal Behavior in Ms. Pac-Man through Evolution of Modular Neural Networks (2016)
Ms. Pac-Man is a challenging video game in which multiple modes of behavior are required: Ms. Pac-Man must escape ghosts when they are threats and catch them when they are edible, in addition to eating all pills in each level. Past approaches to learning behavior in Ms. Pac-Man have treated the game as a single task to be learned using monolithic policy representations. In contrast, this paper uses a framework called Modular Multiobjective NEAT (MM-NEAT) to evolve modular neural networks. Each module defines a separate behavior. The modules are used at different times according to a policy that can be humandesigned (i.e. Multitask) or discovered automatically by evolution. The appropriate number of modules can be fixed or discovered using a genetic operator called Module Mutation. Several versions of Module Mutation are evaluated in this paper. Both fixed modular networks and Module Mutation networks outperform monolithic networks and Multitask networks. Interestingly, the best networks dedicate modules to critical behaviors (such as escaping when surrounded after luring ghosts near a power pill) that do not follow the customary division of the game into chasing edible and escaping threat ghosts. The results demonstrate that MM-NEAT can discover interesting and effective behavior for agents in challenging games.
View:
PDF
Citation:
IEEE Transactions on Computational Intelligence and AI in Games, 8(1):67--81, March 2016.
Bibtex:

Risto Miikkulainen Faculty risto [at] cs utexas edu
Jacob Schrum Ph.D. Alumni schrum2 [at] southwestern edu
MM-NEAT Download at GitHub

Modular Multiobjective NEAT is a software fra...
2014