Plane-Based Optimization for 3D Object Reconstruction from Single Line Drawings

• Published in: IEEE transactions on pattern analysis and machine intelligence 2008-02, Vol.30 (2), p.315-327
• Main Authors: Liu, Jianzhuang, Cao, Liangliang, Li, Zhenguo, Tang, Xiaoou
• Format: Article
• Language: English
• Subjects: 3D object reconstruction; Algorithms; Applied sciences; Artificial intelligence; Circuits; Computer science; control theory; systems; Constraint optimization; degree of reconstruction freedom; Exact sciences and technology; Image reconstruction; line drawing; Machine vision; Mathematical analysis; Mathematical models; Matrix decomposition; Methods; Null space; nullspace; Optimization; Optimization methods; Pattern recognition. Digital image processing. Computational geometry; Projection; Reconstruction; Singular value decomposition; Solid modeling; Studies; Three dimensional; Transmission line matrix methods
• ISSN: 0162-8828; 1939-3539
• DOI: 10.1109/TPAMI.2007.1172

In previous optimization-based methods of 3D planar-faced object reconstruction from single 2D line drawings, the missing depths of the vertices of a line drawing (and other parameters in some methods) are used as the variables of the objective functions. A 3D object with planar faces is derived by finding values for these variables that minimize the objective functions. These methods work well for simple objects with a small number TV of variables. As N grows, however, it is very difficult for them to find the expected objects. This is because with the nonlinear objective functions in a space of large dimension , the search for optimal solutions can easily get trapped into local minima. In this paper, we use the parameters of the planes that pass through the planar faces of an object as the variables of the objective function. This leads to a set of linear constraints on the planes of the object, resulting in a much lower dimensional null space where optimization is easier to achieve. We prove that the dimension of this null space is exactly equal to the minimum number of vertex depths that define the 3D object. Since a practical line drawing is usually not an exact projection of a 3D object, we expand the null space to a larger space based on the singular value decomposition of the projection matrix of the line drawing. In this space, robust 3D reconstruction can be achieved. Compared with the two most related methods, our method not only can reconstruct more complex 3D objects from 2D line drawings but also is computationally more efficient.