neural networks research group
areas
people
projects
demos
publications
software/data
Transfer of Neuroevolved Controllers in Unstable Domains (2004)
Faustino J. Gomez
and
Risto Miikkulainen
In recent years, the evolution of artificial neural networks or neuroevolution has brought promising results in solving difficult reinforcement learning problems. But, like standard RL methods, it requires that solutions be discovered in simulation and then be transferred to the real world. To date, transfer has been studied primarily in mobile robot problems that exhibit stability. This paper presents the first study of transfer in an unstable environment. Using the double pole balancing task, we simulate the process of transferring controllers from simulation to the real-world, and show that the appropriate use of noise during evolution can improve transfer significantly by compensating for inaccuracy in the simulator.
View:
PDF
,
PS
Citation:
In
Proceedings of the Genetic and Evolutionary Computation Conference
, Berlin, 2004. Springer.
Bibtex:
@InProceedings{gomez:gecco04, title={Transfer of Neuroevolved Controllers in Unstable Domains}, author={Faustino J. Gomez and Risto Miikkulainen}, booktitle={Proceedings of the Genetic and Evolutionary Computation Conference}, address={Berlin}, publisher={Springer}, url="http://nn.cs.utexas.edu/?gomez:gecco04", year={2004} }
People
Faustino Gomez
Postdoctoral Alumni
tino [at] idsia ch
Risto Miikkulainen
Faculty
risto [at] cs utexas edu
Areas of Interest
Evolutionary Computation
Neuroevolution
Reinforcement Learning
Control