SAPIEN: A SimulAted Part-based Interactive ENvironment

Building home assistant robots has long been a pursuit for vision and robotics researchers. To achieve this task, a simulated environment with physically realistic simulation, sufficient articulated objects, and transferability to the real robot is indispensable. Existing environments achieve these...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2020-03
Main Authors: Fanbo Xiang, Qin, Yuzhe, Mo, Kaichun, Xia, Yikuan, Zhu, Hao, Liu, Fangchen, Liu, Minghua, Jiang, Hanxiao, Yuan, Yifu, Wang, He, Li, Yi, Chang, Angel X, Guibas, Leonidas J, Su, Hao
Format: Article
Language:English
Subjects:
Algorithms
Cognition
Computer simulation
Computer vision
Machine learning
Machine vision
Motion perception
Robotics
Robots
State-of-the-art reviews
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Building home assistant robots has long been a pursuit for vision and robotics researchers. To achieve this task, a simulated environment with physically realistic simulation, sufficient articulated objects, and transferability to the real robot is indispensable. Existing environments achieve these requirements for robotics simulation with different levels of simplification and focus. We take one step further in constructing an environment that supports household tasks for training robot learning algorithm. Our work, SAPIEN, is a realistic and physics-rich simulated environment that hosts a large-scale set for articulated objects. Our SAPIEN enables various robotic vision and interaction tasks that require detailed part-level understanding.We evaluate state-of-the-art vision algorithms for part detection and motion attribute recognition as well as demonstrate robotic interaction tasks using heuristic approaches and reinforcement learning algorithms. We hope that our SAPIEN can open a lot of research directions yet to be explored, including learning cognition through interaction, part motion discovery, and construction of robotics-ready simulated game environment.
ISSN:2331-8422