A practical spatial re-ranking method for instance search from videos

Spatial re-ranking has proved to be successful in image retrieval. Yet no work on spatial re-ranking has been systematically reported for instance search from videos so far: As videos are composed of multiple frames, and frame-by-frame spatial verification is too prohibitive, till now we lack an eff...

Full description

Saved in:
Bibliographic Details
Main Authors: Xiao Zhou, Cai-Zhi Zhu, Qiang Zhu, Satoh, Shin'ichi, Yu-Tang Guo
Format: Conference Proceeding
Language:English
Subjects:
Feature extraction
instance search
object retrieval
RANSAC
Search problems
Spatial re-ranking
Vectors
video retrieval
Videos
Visualization
Vocabulary
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Spatial re-ranking has proved to be successful in image retrieval. Yet no work on spatial re-ranking has been systematically reported for instance search from videos so far: As videos are composed of multiple frames, and frame-by-frame spatial verification is too prohibitive, till now we lack an efficient spatial re-ranking method designed for the purpose of video instance search. The effectiveness is unclear as well. This paper proposes a practical spatial re-ranking method for video instance search. We make two contributions to speed up the algorithm: One is to select the most representative image/frame for spatial verification, based on the available Bag-of-Words representation; the other is to efficiently build tentative matching feature pairs, which serve as the input of the RANSAC algorithm, by regarding features quantized to the same visual word as matches, thus avoid the costly nearest-neighbor search. These two modifications lead one order of magnitude speedup without compromising the performance. Another contribution is a ROI-originated RANSAC method, which improves the re-ranking performance significantly. Experiments were carried out on the TrecVid Instance Search 2013 dataset, and the new state-of-the-art performance was achieved by the proposed method, at a much faster speed.
ISSN:1522-4880
2381-8549
DOI:10.1109/ICIP.2014.7025608