Global Manifold Learning for Interactive Image Segmentation

• Published in: IEEE transactions on multimedia 2021, Vol.23, p.3239-3249
• Main Authors: Wang, Tao, Ji, Zexuan, Yang, Jian, Sun, Quansen, Fu, Peng
• Format: Article
• Language: English
• Subjects: Algorithms; Equivalence; Estimation; Geometry; global effects; Global geometry; Image segmentation; Interactive image segmentation; label propagation; Machine learning; manifold learning; Manifolds; Manifolds (mathematics); Probabilistic logic; Sun; Tensile stress; Tensors
• ISSN: 1520-9210; 1941-0077
• DOI: 10.1109/TMM.2020.3021979

This paper presents an interactive image segmen-tation algorithm, in which the segmentation problem is formulated as a global manifold learning process. Based on the principle that the label of each element depends on the influence of all the elements in the image, we extend the conventional local neighborhood or the long range regional relationships to the global relationships over the whole image. A probabilistic framework is established to measure the global effect of each element on all other elements. Based on two different manifold learning styles, the semi-global manifold learning (SGML) and the fully-global manifold learning (FGML) algorithms are proposed to capture the global geometry structure of the data manifold. SGML learns the intrinsic effects of each element separately, equivalent to a matrix diffusion process on an affinity graph. FGML learns the intrinsic effects of all elements together, equivalent to a label pair diffusion process on a higher-order tensor product graph. The global manifold learning helps to overcome the low contrast, weak boundary and texture problems. Extensive experiments on three public interactive segmentation datasets demonstrate the superior performance of the proposed algorithms both in accuracy and efficiency.