neural networks research group
areas
people
projects
demos
publications
software/data
Neuroannealing: Martingale-Driven Optimization for Neural Networks (2013)
Alan J Lockett
and
Risto Miikkulainen
Neural networks are effective tools to solve prediction, modeling, and control tasks. However, methods to train neural networks have been less successful on control problems that require the network to model intricately structured regions in state space. This paper presents neuroannealing, a method for training neural network controllers on such problems. Neuroannealing is based on evolutionary annealing, a global optimization method that leverages all available information to search for the global optimum. Because neuroannealing retains all intermediate solutions, it is able to represent the fitness landscape more accurately than traditional generational methods and so finds solutions that require greater network complexity. This hypothesis is tested on two problems with fractured state spaces. Such problems are difficult for other methods such as NEAT because they require relatively deep network topology in order to extract the relevant features of the network inputs. Neuroannealing outperforms NEAT on these problems, supporting the hypothesis. Overall, neuroannealing is a promising approach for training neural networks to solve complex practical problems.
View:
PDF
Citation:
In
Proceedings of the 2013 Genetic and Evolutionary Computation Conference (GECCO-2013)
, 2013. ACM Press.
Bibtex:
@inproceedings{lockett:gecco2013, title={Neuroannealing: Martingale-Driven Optimization for Neural Networks}, author={Alan J Lockett and Risto Miikkulainen}, booktitle={Proceedings of the 2013 Genetic and Evolutionary Computation Conference (GECCO-2013)}, publisher={ACM Press}, url="http://nn.cs.utexas.edu/?lockett:gecco2013", year={2013} }
People
Alan J. Lockett
Ph.D. Alumni
alan lockett [at] gmail com
Risto Miikkulainen
Faculty
risto [at] cs utexas edu
Projects
Learning Strategic Behavior in Sequential Decision Tasks
2009 - 2014
Areas of Interest
Evolutionary Computation
Neuroevolution
Theory of Evolutionary Computation