L6DNet: Light 6 DoF Network for Robust and Precise Object Pose Estimation with Small Datasets

Estimating the 3D pose of an object is a challenging task that can be considered within augmented reality or robotic applications. In this paper, we propose a novel approach to perform 6 DoF object pose estimation from a single RGB-D image. We adopt a hybrid pipeline in two stages: data-driven and g...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2022-05
Main Authors: Gonzalez, Mathieu, Kacete, Amine, Murienne, Albert, Marchand, Eric
Format: Article
Language:English
Subjects:
Augmented reality
Cameras
Coordinates
Image classification
Offsets
Robotics
Robustness
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Estimating the 3D pose of an object is a challenging task that can be considered within augmented reality or robotic applications. In this paper, we propose a novel approach to perform 6 DoF object pose estimation from a single RGB-D image. We adopt a hybrid pipeline in two stages: data-driven and geometric respectively. The data-driven step consists of a classification CNN to estimate the object 2D location in the image from local patches, followed by a regression CNN trained to predict the 3D location of a set of keypoints in the camera coordinate system. To extract the pose information, the geometric step consists in aligning the 3D points in the camera coordinate system with the corresponding 3D points in world coordinate system by minimizing a registration error, thus computing the pose. Our experiments on the standard dataset LineMod show that our approach is more robust and accurate than state-of-the-art methods. The approach is also validated to achieve a 6 DoF positioning task by visual servoing.
ISSN:2331-8422
DOI:10.48550/arxiv.2002.00911