Super-vector coding features extracted from both depth buffer and view-normal-angle images for part-based 3D shape retrieval

• Published in: Multimedia tools and applications 2017-11, Vol.76 (21), p.22059-22076
• Main Authors: Tashiro, Shoki, Tatsuma, Atsushi, Aono, Masaki
• Format: Article
• Language: English
• Subjects: 3-D technology; Augmented reality; Buffers; CAD/CAM; Coding; Computer Communication Networks; Computer Science; Data Structures and Information Theory; Feature extraction; Mechanical engineering; Mixed reality; Multimedia Information Systems; Ranking; Retrieval; Shape recognition; Special Purpose and Application-Based Systems; Three dimensional models
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-017-4801-z

We have witnessed 3D shape models abundant in many application fields including 3D CAD/CAM, augmented/mixed reality (AR/MR), and entertainment. Creating 3D shape models from scratch is still very expensive. Efficient and accurate methods for shape retrieval is essential for 3D shape models to be reused. To retrieve similar 3D shape models, one must provide an arbitrary 3D shape as a query. Most of the research on 3D shape retrieval has been conducted with a “whole” shape as a query (aka whole-to-whole shape retrieval), while a “part” shape (aka part-to-whole shape retrieval) is more practically requested as a query especially by mechanical engineering with 3D CAD/CAM applications. A “part” shape is naturally constructed by a 3D range scanner as an input device. In this paper, we focus on the efficient method for part-to-whole shape retrieval where the “part” shape is assumed to be given by a 3D range scanner. Specifically, we propose a Super-Vector coding feature with SURF local features extracted from the View-Normal-Angle image, or the image synthesized by taking account of the angle between the view vector and the surface normal vector, together with the depth-buffered image, for part-to-whole shape retrieval. In addition, we propose a weighted whole-to-whole re-ranking method taking advantage of global information based on the result of part-to-whole shape retrieval. Through experiments we demonstrate that our proposed method outperforms the previous methods with or without re-ranking.