RETRIEVAL-An Online Performance Evaluation Tool for Information Retrieval Methods

Performance evaluation is one of the main research topics in information retrieval. Evaluation metrics are used to quantify various performance aspects of a retrieval method. These metrics assist in identifying the optimum method for a specific retrieval challenge but also to allow its parameters fi...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on multimedia 2018-01, Vol.20 (1), p.119-127
Main Authors: Ioannakis, George, Koutsoudis, Anestis, Pratikakis, Ioannis, Chamzas, Christodoulos
Format: Article
Language:English
Subjects:
Benchmark testing
Evaluation
Indexes
information
Information retrieval
metrics
Multimedia communication
Performance evaluation
retrieval
Web
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Performance evaluation is one of the main research topics in information retrieval. Evaluation metrics are used to quantify various performance aspects of a retrieval method. These metrics assist in identifying the optimum method for a specific retrieval challenge but also to allow its parameters fine-tuning in order to achieve a robust operation for a given set of requirements specification. In this work, we present RETRIEVAL, a Web-based integrated information retrieval performance evaluation platform. It offers a number of metrics that are popular within the scientific community, so as to compose an efficient framework for implementing performance evaluation. We discuss the functionality of RETRIEVAL by citing important aspects such as the data input approaches, the user-level performance metrics parameterization, the evaluation scenarios, the interactive plots, and the performance reports repository that offers both archiving and download functionalities.
ISSN:1520-9210
1941-0077
DOI:10.1109/TMM.2017.2716193