Sketch based modeling and editing via shape space exploration

• Published in: Multimedia tools and applications 2020-07, Vol.79 (25-26), p.18121-18142
• Main Authors: Liu, Juncheng, Lian, Zhouhui, Xiao, Jianguo
• Format: Article
• Language: English
• Subjects: Computer Communication Networks; Computer Science; Data Structures and Information Theory; Deformation; Editing; Multimedia Information Systems; Sketches; Space exploration; Special Purpose and Application-Based Systems
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-020-08677-0

This paper proposes a framework that takes a user provided free-hand sketch as input and realistic 3D shape as result. Specifically, the proposed approach retrieves 3D shape based on a sketch, and then a deformation procedure is carried out for a further consistency with the provided sketch. In the retrieval stage, a locality preserving view selection scheme is proposed, which suggests views that are mostly possible to be views when creating a sketch. The proposed criterion predicates the sketch views accurately while significantly reduces the number of views that need to be rendered. In the deformation stage, retrieved shapes are modified according to sketch. However, it is a tremendously difficult job as free-hand sketches always contain various kinds of drawing errors such as stroke jittering and asymmetry. Extracting plausible deformation from sketch while discarding undesirable drawing errors is difficult. To address these issues, we obtain the plausible deformation contained in sketch by exploring a shape space trained by a collection of shapes in the same category. Furthermore, we also develop a user interface with two different intuitive editing modes based on the shape space established. Experimental results show that more consistent 3D shapes with sketches can be obtained by our method. We also illustrate that our proposed method provides easy and smart ways for both a heuristic and a purposeful shape editing.