neural networks research group
areas • people • projects • demos • publications • software/data •
Todd Hester
Todd's research focused on reinforcement learning and robotics, specifically looking at the exploration versus exploitation problem in reinforcement learning and working to apply it to large domains. Before coming to UT, Todd worked in the Motion Analysis Laboratory at Spaulding Rehabiliation Hospital, Motorola, Sun Microsystems, and the Air Force Research Laboratory. Outside of his research, Todd enjoys ultimate frisbee and foosball and is a dedicated New England Patriots fan.
Homepage:
http://www.cs.utexas.edu/~todd
Projects
TEXPLORE: Real-Time Sample Efficient Reinforcement Learning Since 2009
The UT Austin Villa Robot Soccer team Since 2003
Demos
TEXPLORE: Real-Time Sample Efficient Reinforcement LearningTodd Hester2012
SPL Robocup Soccer2008
Publications
     [Expand to show all 24][Minimize]
Intrinsically motivated model learning for developing curious robots Todd Hester and Peter Stone Artificial Intelligence, May 2015. Elsevier. 2015
UT Austin Villa 2012: Standard Platform League World Champions Samuel Barrett, Katie Genter, Yuchen He, Todd Hester, Piyush Khandelwal, Jacob Menashe, and Peter St... In Xiaoping Chen and Peter Stone and Luis Enrique Sucar and Tijn Van der Zant, editors, RoboCup-2... 2013
Learning Exploration Strategies in Model-Based Reinforcement Learning Todd Hester and Manuel Lopes and Peter Stone In The Twelfth International Conference on Autonomous Agents and Multiagent Systems (AAMAS), ... 2013
The 2012 {UT Austin Villa} Code Release Samuel Barrett and Katie Genter and Yuchen He and Todd Hester and Piyush Khandelwal and Jacob Menash... In {R}obo{C}up-2013: Robot Soccer World Cup {XVII}, 2013. 2013
The Open-Source TEXPLORE Code Release for Reinforcement Learning on Robots Todd Hester and Peter Stone In Sven Behnke and Arnoud Visser and Rong Xiong and Manuela Veloso, editors, RoboCup-2013: Robot ... 2013
{RTMBA}: A Real-Time Model-Based Reinforcement Learning Architecture for Robot Control Todd Hester and Michael Quinlan and Peter Stone In {IEEE} International Conference on Robotics and Automation (ICRA), May 2012. 2012
{A}ustin {V}illa 2011: Sharing is Caring: Better Awareness through Information Sharing Samuel Barrett and Katie Genter and Todd Hester and Piyush Khandelwal and Michael Quinlan and Peter ... Technical Report, Department of Computer Science, The University of Texas at Austin, January 2012. T... 2012
Intrinsically Motivated Model Learning for a Developing Curious Agent Todd Hester and Peter Stone In Eleventh International Conference on Autonomous Agents and Multiagent Systems - Adaptive Learn... 2012
Intrinsically Motivated Model Learning for a Developing Curious Agent Todd Hester and Peter Stone In The Eleventh International Conference on Development and Learning (ICDL), Nov 2012. 2012
{TEXPLORE}: Real-Time Sample-Efficient Reinforcement Learning for Robots Todd Hester and Peter Stone Machine Learning, 2012. 2012
TEXPLORE: Temporal Difference Reinforcement Learning for Robots and Time-Constrained Domains. Todd Hester PhD Thesis, The University of Texas at Austin, Austin, Texas, USA, December 2012. Code available at:... 2012
Austin Villa 2010 Standard Platform Team Report Samuel Barrett and Katie Genter and Matthew Hausknecht and Todd Hester and Piyush Khandelwal and Juh... Technical Report, Department of Computer Science, The University of Texas at Austin, January 2011. T... 2011
A Real-Time Model-Based Reinforcement Learning Architecture for Robot Control Todd Hester and Michael Quinlan and Peter Stone %RefShort% 2011
Learning and Using Models Todd Hester and Peter Stone In Reinforcement Learning: State of the Art, 2011. 2011
Generalized Model Learning for Reinforcement Learning on a Humanoid Robot Todd Hester and Michael Quinlan and Peter Stone In International Conference on Robotics and Automation, 2010. 2010
Real Time Targeted Exploration in Large Domains Todd Hester and Peter Stone In 2010, editors, Proceedings of the Ninth International Conference on Development and Learning (... 2010
Controlled Kicking under Uncertainty Samuel Barrett and Katie Genter and Todd Hester and Michael Quinlan and Peter Stone In The Fifth Workshop on Humanoid Soccer Robots at Humanoids 2010, Nashville, TN, 2010. 2010
Generalized Model Learning for Reinforcement Learning in Factored Domains Todd Hester and Peter Stone In The Eighth International Conference on Autonomous Agents and Multiagent Systems (AAMAS), M... 2009
Three Humanoid Soccer Platforms: Comparison and Synthesis Shivaram Kalyanakrishnan and Todd Hester and Michael Quinlan and Yinon Bentor and Peter Stone In Proceedings of the RoboCup International Symposium 2009, 2009. Springer Verlag. 2009
An Empirical Comparison of Abstraction in Models of Markov Decision Processes Todd Hester and Peter Stone In Proceedings of the ICML/UAI/COLT Workshop on Abstraction in Reinforcement Learning, June 2... 2009
TT-UT Austin Villa 2009: Naos across Texas Todd Hester and Michael Quinlan and Peter Stone and Mohan Sridharan Technical Report UT-AI-TR-09-08, The University of Texas at Austin, Department of Computer Science, ... 2009
The Utility of Temporal Abstraction in Reinforcement Learning Nicholas K. Jong and Todd Hester and Peter Stone In The Seventh International Joint Conference on Autonomous Agents and Multiagent Systems, M... 2008
Negative Information and Line Observations for Monte Carlo Localization Todd Hester and Peter Stone In IEEE International Conference on Robotics and Automation, May 2008. 2008
UT Austin Villa 2008: Standing on Two Legs Todd Hester, Michael Quinlan, and Peter Stone Technical Report UT-AI-TR-08-8, The University of Texas at Austin, Department of Computer Sciences, ... 2008
Areas of Interest
Real Robot Soccer RoboCup Robot Soccer Reinforcement Learning Robotics
UT Only: Advice • Calendar • Admin