Neuroevolution in Real Time Games
Since 2005
The goal of this project is to evaluate and improve Neuroevolution as a machine learning technique in a wide variety of complex environments provided by real-time computer games. To date, we have used the TIELT framework to embed the NEAT algorithm in the Unreal Tournament computer game, successfully evolving simple navigation behaviors. Our work has also allowed us to propose a set of improvements for TIELT (Testbed for Integration and Evaluation of Learning Techniques), which is a platform that seeks to provide researchers with a uniform interface to a library of computer game environments.
  • Example of initial (random) agent behavior (AVI, MOV)
  • Example of evolved agent behavior: the agent moves towards a target on the left wall of the level (AVI, MOV)
Igor V. Karpov Ph.D. Student ikarpov [at] gmail com
Kenneth Stanley Postdoctoral Alumni kstanley [at] cs ucf edu
Evaluating team behaviors constructed with human-guided machine learning Igor V. Karpov, Leif M. Johnson and Risto Miikkulainen To Appear In Proceedings of the IEEE Conference on Computational Intelligence in Games, Augus... 2015

Evaluation Methods for Active Human-Guided Neuroevolution in Games Igor Karpov, Leif Johnson, Vinod Valsalam and Risto Miikkulainen In 2012 AAAI Fall Symposium on Robots Learning Interactively from Human Teachers (RLIHT), Nov... 2012

Assisting Machine Learning Through Shaping, Advice and Examples Igor Karpov, Vinod Valsalam and Risto Miikkulainen In 2011 IJCAI Workshop on Agents Learning Interactively from Human Teachers (ALIHT), July 201... 2011

Human-Assisted Neuroevolution Through Shaping, Advice and Examples Igor V. Karpov, Vinod K. Valsalam and Risto Miikkulainen In Proceedings of the 13th Annual Genetic and Evolutionary Computation Conference (GECCO 2011) 2011

Computational Intelligence in Games Risto Miikkulainen, Bobby D. Bryant, Ryan Cornelius, Igor V. Karpov, Kenneth O. Stanley, and Chern H... In Gary Y. Yen and David B. Fogel, editors, Computational Intelligence: Principles and Practice<... 2006

Creating Intelligent Agents in Games Risto Miikkulainen The Bridge:5-13, 2006. 2006

Integration and Evaluation of Exploration-Based Learning in Games Igor V. Karpov, Thomas D'Silva, Craig Varrichio, Kenneth O. Stanley, Risto Miikkulainen In Proceedings of the {IEEE} Symposium on Computational Intelligence and Games, Reno, NV, 20... 2006