It is difficult to discover effective behavior for NPCs automatically. For instance, evolutionary methods can learn sophisticated behaviors based on a single objective, but realistic game playing requires different behaviors at different times. Such complex behavior is difficult to achieve. What is needed are multi-objective methods that reward different behaviors separately, and allow them to be combined to produce multi-modal behavior. While such methods exist, they have not yet been applied to generating multi-modal behavior for NPCs. This paper presents such an application: In a domain with noisy evaluations and contradictory fitness objectives, evolution based on a scalar fitness function is inferior to multi-objective optimization. The multi-objective approach produces agents that excel at the task and develop complex, interesting behaviors.

PDF

In Proceedings of the Fourth Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE 2008), 108-113, Stanford, California, 2008.

@inproceedings{schrum:aiide08, title={Constructing Complex NPC Behavior via Multi-Objective Neuroevolution}, author={Jacob Schrum and Risto Miikkulainen}, booktitle={Proceedings of the Fourth Artificial Intelligence and Interactive Digital Entertainment Conference (AIIDE 2008)}, address={Stanford, California}, pages={108-113}, url="http://nn.cs.utexas.edu/?schrum:aiide08", year={2008} }

Slides (PPT)