Inferring human intent from video by sampling hierarchical plans

This paper presents a method which allows robots to infer a human's hierarchical intent from partially observed RGBD videos by imagining how the human will behave in the future. This capability is critical for creating robots which can interact socially or collaboratively with humans. We repres...

Full description

Saved in:
Bibliographic Details
Main Authors: Holtzen, Steven, Yibiao Zhao, Tao Gao, Tenenbaum, Joshua B., Song-Chun Zhu
Format: Conference Proceeding
Language:English
Subjects:
Bayes methods
Grammar
Planning
Probabilistic logic
Production
Robots
Trajectory
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents a method which allows robots to infer a human's hierarchical intent from partially observed RGBD videos by imagining how the human will behave in the future. This capability is critical for creating robots which can interact socially or collaboratively with humans. We represent intent as a novel hierarchical, compositional, and probabilistic And-Or graph structure which describes a relationship between actions and plans. We infer human intent by reverse-engineering a human's decision-making and action planning processes under a Bayesian probabilistic programming framework. We present experiments from a 3D environment which demonstrate that the inferred human intent (1) matches well with human judgment, and (2) provides useful contextual cues for object tracking and action recognition.
ISSN:2153-0866
DOI:10.1109/IROS.2016.7759242