neural networks research group
areas
people
projects
demos
publications
software/data
Evolving Multimodal Behavior Through Subtask and Switch Neural Networks (2014)
Xun Li
and
Risto Miikkulainen
While neuroevolution has been used successfully to discover effective control policies for intelligent agents, it has been difficult to evolve behavior that is multimodal, i.e. consists of distinctly different behaviors in different situations. This article proposes a new method, Modular NeuroEvolution of Augmenting Topologies (ModNEAT), to meet this challenge. ModNEAT decomposes complex tasks into tractable subtasks and utilizes neuroevolution to learn each subtask. Switch networks are evolved with the subtask networks to arbitrate among them and thus combine separate subtask networks into a complete hierarchical policy. Further, the need for new subtask modules is detected automatically by monitoring fitness of the agent population. Experimental results in the machine learning game of OpenNERO showed that ModNEAT outperforms the non-modular rtNEAT in both agent fitness and training efficiency.
View:
PDF
Citation:
In
Proceedings of The Fourteenth International Conference on the Synthesis and Simulation of Living Systems (ALIFE 14)
, 2014.
Bibtex:
@inproceedings{li:alife14, title={Evolving Multimodal Behavior Through Subtask and Switch Neural Networks}, author={Xun Li and Risto Miikkulainen}, booktitle={Proceedings of The Fourteenth International Conference on the Synthesis and Simulation of Living Systems (ALIFE 14)}, url="http://nn.cs.utexas.edu/?li:alife14", year={2014} }
People
Xun Li
Ph.D. Alumni
xun bhsfer [at] cs utexas edu
Risto Miikkulainen
Faculty
risto [at] cs utexas edu
Projects
The Role of Emotion and Communication in Cooperative Behavior
2013 - 2016
Areas of Interest
Evolutionary Computation
Neuroevolution
Applications