Correlated Topic Vector for Scene Classification

Scene images usually involve semantic correlations, particularly when considering large-scale image data sets. This paper proposes a novel generative image representation, correlated topic vector, to model such semantic correlations. Oriented from the correlated topic model, correlated topic vector...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on image processing 2017-07, Vol.26 (7), p.3221-3234
Main Authors: Wei, Pengxu, Qin, Fei, Wan, Fang, Zhu, Yi, Jiao, Jianbin, Ye, Qixiang
Format: Article
Language:English
Subjects:
Correlated topic vector
Correlation
Feature extraction
Fisher kernel
generative feature learning
Image coding
Image recognition
Kernel
semantic correlation
Semantics
Visualization
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Scene images usually involve semantic correlations, particularly when considering large-scale image data sets. This paper proposes a novel generative image representation, correlated topic vector, to model such semantic correlations. Oriented from the correlated topic model, correlated topic vector intends to naturally utilize the correlations among topics, which are seldom considered in the conventional feature encoding, e.g., Fisher vector, but do exist in scene images. It is expected that the involvement of correlations can increase the discriminative capability of the learned generative model and consequently improve the recognition accuracy. Incorporated with the Fisher kernel method, correlated topic vector inherits the advantages of Fisher vector. The contributions to the topics of visual words have been further employed by incorporating the Fisher kernel framework to indicate the differences among scenes. Combined with the deep convolutional neural network (CNN) features and Gibbs sampling solution, correlated topic vector shows great potential when processing large-scale and complex scene image data sets. Experiments on two scene image data sets demonstrate that correlated topic vector improves significantly the deep CNN features, and outperforms existing Fisher kernel-based features.
ISSN:1057-7149
1941-0042
DOI:10.1109/TIP.2017.2694320