MM-NEAT
Released 2014
Download at GitHub

Modular Multiobjective NEAT is a software framework in Java that builds on the basic principles of Neuro-Evolution of Augmenting Topologies. MM-NEAT uses Non-Dominated Sorting Genetic Algorithm II to carry out multiobjective evolution, and supports networks with multiple output modules. Evolved agents can use different modules for different behaviors: Human-specified task divisions can be defined using the Multitask Learning approach, or the task division can be learned using preference neurons. Evolution can also learn how many modules to use with various forms of Module Mutation. Finally, multiobjective evolution can be improved using Targeting Unachieved Goals (TUG), a fitness-based shaping technique that turns objectives off when they are not needed. For more information on these techniques, see the associated publications.

The primary domain in which these methods were evaluated is Ms. Pac-Man. Batch files are included to recreate all experiments from Jacob Schrum's 2014 dissertation. Some RL-Glue domains are also included, as well as a simplified version of BREVE Monsters, which is a precursor to MM-NEAT.

Version history:
Version 3.0+: September 2017
Project moves to GitHub at this address. Project is still active and ongoing, but has been overhauled to use Maven for dependency management. Major developments in this version include: Version 2.0: June 2016
On GitHub at this address. The version at this site will no longer be supported, but work continues on version 3.0+ mentioned above. However, some additions in version 2.0 included:
  • Added support for HyperNEAT
  • Evolution in Tetris via RL-Glue
  • Many developments in a toroidal predator/prey grid-world
  • Re-implementation of the Picbreeder system
  • Beginnings of rudimentary support for VizDoom (work ongoing)
Version 1.1: October 2015
Code for a new version of Ms. Pac-Man featuring isolated tasks is added, as well as batch files that launch experiments in this domain.
Version 1.0: May 2014
Initial release containing code from Jacob Schrum's 2014 dissertation.
Jacob Schrum Ph.D. Alumni schrum2 [at] southwestern edu
Discovering Multimodal Behavior in Ms. Pac-Man through Evolution of Modular Neural Networks Jacob Schrum and Risto Miikkulainen IEEE Transactions on Computational Intelligence and AI in Games, 8(1):67--81, March 2016. 2016

Solving Multiple Isolated, Interleaved, and Blended Tasks through Modular Neuroevolution Jacob Schrum and Risto Miikkulainen Evolutionary Computation, 24(3):459--490, September 2016. MIT Press. 2016

Neuroevolution Risto Miikkulainen In Sammut, C. and Webb, G. I., editors, Encyclopedia of Machine Learning, 2nd Edition, Berlin... 2015

Solving Interleaved and Blended Sequential Decision-Making Problems through Modular Neuroevolution Jacob Schrum and Risto Miikkulainen In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2015), 345--352,... 2015

Evolving Multimodal Behavior Through Modular Multiobjective Neuroevolution Jacob Schrum PhD Thesis, The University of Texas at Austin, Austin, TX 78712, May 2014. Tech Report TR-14-07. 2014

Evolving Multimodal Behavior With Modular Neural Networks in Ms. Pac-Man Jacob Schrum and Risto Miikkulainen In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO 2014), 325--332,... 2014