Visual and semantic similarity in ImageNet

Many computer vision approaches take for granted positive answers to questions such as "Are semantic categories visually separable?" and "Is visual similarity correlated to semantic similarity?". In this paper, we study experimentally whether these assumptions hold and show paral...

Full description

Saved in:
Bibliographic Details
Main Authors: Deselaers, T., Ferrari, V.
Format: Conference Proceeding
Language:English
Subjects:
Animals
Computer vision
Histograms
Humans
Prototypes
Semantics
Visualization
Citations: Items that cite this one
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Many computer vision approaches take for granted positive answers to questions such as "Are semantic categories visually separable?" and "Is visual similarity correlated to semantic similarity?". In this paper, we study experimentally whether these assumptions hold and show parallels to questions investigated in cognitive science about the human visual system. The insights gained from our analysis enable building a novel distance function between images assessing whether they are from the same basic-level category. This function goes beyond direct visual distance as it also exploits semantic similarity measured through ImageNet. We demonstrate experimentally that it outperforms purely visual distances.
ISSN:1063-6919
DOI:10.1109/CVPR.2011.5995474