Justin Hart
I am a clinical assistant professor with the College of Natural Sciences at the University of Texas at Austin and a postdoctoral fellow affiliated with the Building-Wide Intelligence Project and the Learning Agents Research Group under the co-supervision of professors Raymond Mooney and Peter Stone in the Department of Computer Science. Currently I am working on grounded language learning for autonomous agents operating in work environments. Previously, I was a postdoctoral fellow at the CARIS Lab at the University of British Columbia where I war advised by Professor Elizabeth Croft. There, I worked on CHARM (Collaborative Human-Focused Assistive Robotics for Manufacturing). The goal of collaborative manufacturing is to break down the barriers in factories that separate robots from humans, allowing them to safely work alongside one another. Similar to my work at UT Austin, my role was to develop mechanisms to allow humans and robots to clearly, naturally communicate with one another, enabling them to quickly, safely, and effectively work together. In September 2014, I defended my dissertation at Yale University where I researched in the Social Robotics Lab, advised by Professor Brian Scassellati. For my PhD research, I constructed a robot that is able to autonomously learn about its sensory and motor capabilities, breaking from the standard practice in which such models, if present at all, are constructed during the design of the robot, by engineers, or meticulously calibrated offline. If robots are able to understand themselves in this way, it will open the possibility of highly robust machines that are able to adapt flexibly to different use cases or to damage, in software, and very precise machines that continuously self-calibrate. The models that my robot constructs are inspired by the process by which children learn about their sensory and physical capabilities and how they are able to interact with the environment, which represent the earliest forms of self-awareness to develop during infancy.
     [Expand to show all 15][Minimize]
Socially CompliAnt Navigation Dataset (SCAND): A Large-Scale Dataset Of Demonstrations For Social Navigation Haresh Karnan and Anirudh Nair and Xuesu Xiao and Garrett Warnell and Soren Pirk and Alexander Toshe... Robotics and Automation Letters (RA-L), 2022, Japan, May 2022. 2022

Incorpotating Gaze into Social Navigation Justin Hart and Reuth Mirsky and Xuesu Xiao and Peter Stone In Robotics: Science and Systems Workshop on Social Robot Navigation (RSS), Virtual, July 202... 2021

Watch Where You're Going! Gaze and Head Orientation as Predictors for Social Robot Navigation Blake Holman and Abrar Anwar and Akash Singh and Mauricio Tec and Justin Hart and Peter Stone In Proceedings of the International Conference on Robotics and Automation (ICRA 2021), Xi'an,... 2021

Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Jus... The Journal of Artificial Intelligence Research (JAIR), 67:327-374, February 2020. 2020

Deep R-Learning for Continual Area Sweeping Rishi Shah and Yuqian Jiang and Justin Hart and Peter Stone In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2... 2020

Using Human-Inspired Signals to Disambiguate Navigational Intentions Justin Hart and Reuth Mirsky and Xuesu Xiao and Stone Tejeda and Bonny Mahajan and Jamin Goo and Kat... In Proceedings of the 12th International Conference on Social Robotics (ICSR), Golden, Colora... 2020

Improving Grounded Natural Language Understanding through Human-Robot Dialog Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Jus... In IEEE International Conference on Robotics and Automation (ICRA), Montreal, Canada, May 201... 2019

Open-World Reasoning for Service Robots Yuqian Jiang, Nick Walker, Justin Hart, Peter Stone In Proceedings of the 29th International Conference on Automated Planning and Scheduling (ICAPS 2... 2019

Optimal Use Of Verbal Instructions For Multi-Robot Human Navigation Guidance Harel Yedidsion, Jacqueline Deans, Connor Sheehan, Mahathi Chillara, Justin Hart, Peter Stone, and R... In Proceedings of the Eleventh International Conference on Social Robotics, 133-143, 2019. Sp... 2019

PRISM: Pose Registration for Integrated Semantic Mapping Justin W. Hart and Rishi Shah and Sean Kirmani and Nick Walker and Kathryn Baldauf and Nathan John a... In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (I... 2018

Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Jus... In RSS Workshop on Models and Representations for Natural Human-Robot Communication (MRHRC-18). ... 2018

Jointly Improving Parsing and Perception for Natural Language Commands through Human-Robot Dialog Jesse Thomason, Aishwarya Padmakumar, Jivko Sinapov, Nick Walker, Yuqian Jiang, Harel Yedidsion, Jus... In Late-breaking Track at the SIGDIAL Special Session on Physically Situated Dialogue (RoboDIAL-1... 2018

Passive Demonstrations of Light-Based Robot Signals for Improved Human Interpretability Rolando Fernandez and Nathan John and Sean Kirmani and Justin Hart and Jivko Sinapov and Peter Stone In Proceedings of the 27th {IEEE} International Symposium on Robot and Human Interactive Communic... 2018

Interaction and Autonomy in RoboCup@Home and Building-Wide Intelligence Justin Hart, Harel Yedidsion, Yuqian Jiang, Nick Walker, Rishi Shah, Jesse Thomason, Aishwarya Padma... In Artificial Intelligence (AI) for Human-Robot Interaction (HRI) symposium, AAAI Fall Symposium ... 2018

Opportunistic Active Learning for Grounding Natural Language Descriptions Jesse Thomason and Aishwarya Padmakumar and Jivko Sinapov and Justin Hart and Peter Stone and Raymon... In Sergey Levine and Vincent Vanhoucke and Ken Goldberg, editors, Proceedings of the 1st Annual C... 2017