Real-Time Simultaneous Multi-Object 3D Shape Reconstruction, 6DoF Pose Estimation and Dense Grasp Prediction

In this paper, we present a realtime method for simultaneous object-level scene understanding and grasp prediction. Specifically, given a single RGBD image of a scene, our method localizes all the objects in the scene and for each object, it generates the following: full 3D shape, scale, pose with r...

Full description

Saved in:
Bibliographic Details
Main Authors: Agrawal, Shubham, Chavan-Dafle, Nikhil, Kasahara, Isaac, Engin, Selim, Huh, Jinwook, Isler, Volkan
Format: Conference Proceeding
Language:English
Subjects:
Cameras
Robot vision systems
Semantics
Shape
Statistical analysis
Three-dimensional displays
Training
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we present a realtime method for simultaneous object-level scene understanding and grasp prediction. Specifically, given a single RGBD image of a scene, our method localizes all the objects in the scene and for each object, it generates the following: full 3D shape, scale, pose with respect to the camera frame, and a dense set of feasible grasps. The main advantage of our method is its computation speed as it avoids sequential perception and grasp planning. With detailed quantitative analysis of reconstruction quality and grasp accuracy, we show that our method delivers competitive performance compared to the state-of-the-art methods, while providing fast inference at 30 frames per second speed.
ISSN:2153-0866
DOI:10.1109/IROS55552.2023.10342307