neural networks research group
areas
people
projects
demos
publications
software/data
An Integrated Neuroevolutionary Approach to Reactive Control and High-level Strategy (2011)
Nate Kohl
,
Risto Miikkulainen
One promising approach to general-purpose artificial intelligence is neuroevolution, which has worked well on a number of problems from resource optimization to robot control. However, state-of-the-art neuroevolution algorithms like NEAT have surprising difficulty on problems that are fractured, i.e. where the desired actions change abruptly and frequently. Previous work demonstrated that bias and constraint (e.g. RBF-NEAT and Cascade-NEAT algorithms) can improve learning significantly on such problems. However, experiments in this paper show that relatively unrestricted algorithms (e.g. NEAT) still yield the best performance on problems requiring reactive control.Ideally, a single algorithm would be able to perform well on both fractured and unfractured problems. This paper introduces such an algorithm called SNAP-NEAT that uses adaptive operator selection to integrate strengths of NEAT, RBF-NEAT, and Cascade-NEAT. SNAP-NEAT is evaluated empirically on a set of problems ranging from reactive control to high-level strategy. The results show that SNAP-NEAT can adapt intelligently to the type of problem that it faces, thus laying the groundwork for learning algorithms that can be applied to a wide variety of problems.
View:
PDF
Citation:
IEEE Transactions on Evolutionary Computation
, 2011.
Bibtex:
@article{kohl:ieeetec11, title={An Integrated Neuroevolutionary Approach to Reactive Control and High-level Strategy}, author={Nate Kohl and Risto Miikkulainen}, journal={IEEE Transactions on Evolutionary Computation}, url="http://nn.cs.utexas.edu/?kohl:ieeetec11", year={2011} }
People
Nate Kohl
Ph.D. Alumni
nate [at] natekohl net
Risto Miikkulainen
Faculty
risto [at] cs utexas edu
Projects
Learning Strategic Behavior in Sequential Decision Tasks
2009 - 2014
Areas of Interest
Neuroevolution