Unsupervised Deep Video Hashing via Balanced Code for Large-Scale Video Retrieval

• Published in: IEEE transactions on image processing 2019-04, Vol.28 (4), p.1993-2007
• Main Authors: Wu, Gengshen, Han, Jungong, Guo, Yuchen, Liu, Li, Ding, Guiguang, Ni, Qiang, Shao, Ling
• Format: Article
• Language: English
• Subjects: balanced rotation; Binary codes; Clustering; deep learning; Feature extraction; feature representation; Hamming distance; Nickel; Optimization; Quantization (signal); similarity retrieval; Training; Video hashing
• ISSN: 1057-7149; 1941-0042
• DOI: 10.1109/TIP.2018.2882155

This paper proposes a deep hashing framework, namely, unsupervised deep video hashing (UDVH), for large-scale video similarity search with the aim to learn compact yet effective binary codes. Our UDVH produces the hash codes in a self-taught manner by jointly integrating discriminative video representation with optimal code learning, where an efficient alternating approach is adopted to optimize the objective function. The key differences from most existing video hashing methods lie in: 1) UDVH is an unsupervised hashing method that generates hash codes by cooperatively utilizing feature clustering and a specifically designed binarization with the original neighborhood structure preserved in the binary space and 2) a specific rotation is developed and applied onto video features such that the variance of each dimension can be balanced, thus facilitating the subsequent quantization step. Extensive experiments performed on three popular video datasets show that the UDVH is overwhelmingly better than the state of the arts in terms of various evaluation metrics, which makes it practical in real-world applications.