A hierarchical grid feature representation framework for automatic image annotation

We propose a hierarchical-grid (HG) feature analysis framework for representing images in automatic image annotation (AIA). We explore the properties of codebooks constructed with different-sized grids in image sub-blocks, and co-occurrence relationship between VQ codewords constructed from differen...

Full description

Saved in:
Bibliographic Details
Main Authors: Ilseo Kim, Chin-Hui Lee
Format: Conference Proceeding
Language:English
Subjects:
Automatic image annotation
Computational efficiency
Feature extraction
Gaussian processes
Grid computing
hierarchical-grid
high-level feature extraction
Image analysis
Image representation
Image retrieval
Indexing
Mercury (metals)
Text categorization
video indexing
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We propose a hierarchical-grid (HG) feature analysis framework for representing images in automatic image annotation (AIA). We explore the properties of codebooks constructed with different-sized grids in image sub-blocks, and co-occurrence relationship between VQ codewords constructed from different grid systems. The proposed HG approach is evaluated on the TRECVID 2005 data set using classifiers obtained with maximal figure-of-merit discriminative training. With multi-level and cross-level grid systems incorporating bigram information within and between higher and lower grid levels, we show that the AIA performance can be significantly improved. For 20 selected concepts from the 39-concept LSCOM-Lite annotation set, we achieve a best F 1 in almost all the concepts. The overall performance improvement with the combined multi-level and cross-level grid systems over the best single-size grid system in micro F 1 is about 12.1%.
ISSN:1520-6149
2379-190X
DOI:10.1109/ICASSP.2009.4959786