Retrieving Images with Generated Textual Descriptions

This paper presents a novel remote sensing (RS) image retrieval system that is defined based on generation and exploitation of textual descriptions that model the content of RS images. The proposed RS image retrieval system is composed of three main steps. The first one generates textual description...

Full description

Saved in:
Bibliographic Details
Main Authors: Hoxha, Genc, Melgani, Farid, Demir, Begum
Format: Conference Proceeding
Language:English
Subjects:
Feature extraction
Image coding
Image retrieval
image textual description generation
Recurrent neural networks
Remote sensing
semantic gap
Semantics
Unmanned aerial vehicles
unmanned aerial vehicles (UAV)
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents a novel remote sensing (RS) image retrieval system that is defined based on generation and exploitation of textual descriptions that model the content of RS images. The proposed RS image retrieval system is composed of three main steps. The first one generates textual descriptions of the content of the RS images combining a convolutional neural network (CNN) and a recurrent neural network (RNN) to extract the features of the images and to generate the descriptions of their content, respectively. The second step encodes the semantic content of the generated descriptions using word embedding techniques able to produce semantically rich word vectors. The third step retrieves the most similar images with respect to the query image by measuring the similarity between the encoded generated textual descriptions of the query image and those of the archive. Experimental results on RS image archive composed of RS images acquired by unmanned aerial vehicles (UAVs) are reported and discussed.
ISSN:2153-7003
DOI:10.1109/IGARSS.2019.8899321