neural networks research group
areas
people
projects
demos
publications
software/data
The Role of Reward Structure, Coordination Mechanism and Net Return in the Evolution of Cooperation (2011)
Padmini Rajagopalan
,
Aditya Rawal
,
Risto Miikkulainen
, Marc A. Wiseman and
Kay E. Holekamp
Biology can offer insight into how realistic artificial agents and complex interactions between them can be created. For instance, spotted hyenas of Western Africa typically hunt alone, but cooperate once in a while to catch zebras. Using hyenas as motivation, this paper evaluates three potential factors that affect the evolution of cooperation in a team of game agents: reward structure (i.e. whether fitness reward is given to an individual agent or shared by the team), coordination mechanism (i.e. stigmergic vs. direct communication), and net return (i.e. the size of reward relative to the difficulty of obtaining it). Through neuroevolution using Multi-Component ESP [1], three predators were evolved in a field containing multiple fixed-behavior prey. Six such experiments show that (1) although shared reward strongly promotes cooperation, it is not strictly necessary for evolving cooperation; (2) although stigmergic coordination works well in simple, unambiguous tasks (i.e. with a single prey), direct communication is more effective in more complex tasks (i.e. with multiple prey); and (3) the predators evolve to hunt alone or cooperatively based on which approach results in higher net return. Insights from these computational simulations can be used to develop more intelligent behaviors for game agents in the future.
View:
PDF
Citation:
In
Proceedings of the IEEE Conference on Computational Intelligence and Games (CIG 2011)
, Seoul, South Korea, 2011.
Bibtex:
@inproceedings{rajagopalan:cig11, title={The Role of Reward Structure, Coordination Mechanism and Net Return in the Evolution of Cooperation}, author={Padmini Rajagopalan and Aditya Rawal and Risto Miikkulainen and Marc A. Wiseman and Kay E. Holekamp}, booktitle={Proceedings of the IEEE Conference on Computational Intelligence and Games (CIG 2011)}, address={Seoul, South Korea}, url="http://nn.cs.utexas.edu/?rajagopalan:cig11", year={2011} }
People
Kay E. Holekamp
Former Collaborator
holekamp [at] msu edu
Risto Miikkulainen
Faculty
risto [at] cs utexas edu
Padmini Rajagopalan
Postdoctoral Alumni
padminir [at] utexas edu
Aditya Rawal
Ph.D. Alumni
aditya [at] cs utexas edu
Projects
Coevolution of Competitive and Cooperative Agent Behavior
Since 2009
Learning Strategic Behavior in Sequential Decision Tasks
2009 - 2014
Demos
Cooperation to Overcome a More Powerful Adversary
Kay Holekamp
2012
The Role of Reward Structure, Coordination Mechanism and Net Return in the Evolution of Cooperation
Padmini Rajagopalan, Aditya Rawal
2011
Areas of Interest
Evolutionary Computation
Neuroevolution
Artificial Life