Learning sparse tag patterns for social image classification

• Main Authors: Jie Lin, Ling-Yu Duan, Junsong Yuan, Qingyong Li, Siwei Luo
• Format: Conference Proceeding
• Language: English
• Subjects: CBIR; Educational institutions; Feature extraction; Image Classification; Noise measurement; Optimization; Semantics; Social Data; Sparse Tag Patterns; Training; Visualization
• ISSN: 1522-4880; 2381-8549
• DOI: 10.1109/ICIP.2012.6467501

User-generated tags associated with images from social media (e.g., Flickr) provide valuable textual resources for image classification. However, the noisy and huge tag vocabulary heavily degrades the effectiveness and efficiency of state-of-the-art image classification methods that exploited auxiliary web data. To alleviate the problem, we introduce a Sparse Tag Patterns (STP) model to discover sparsity constrained co-occurrence tag patterns from large scale user contributed tags among social data. To fulfill the compactness and discriminability, we formulate STP as a problem of minimizing a quadratic loss function regularized by the bi-layer l 1 norm. We treat the learned STP as alternative intermediate semantic image feature and verify its superiority within a search-based image classification framework. Experiments on 240K social images associated with millions of tags have demonstrated encouraging performance of the proposed method compared to the state-of-the-art.