The OWL Reasoner Evaluation (ORE) 2015 Competition Report

The OWL Reasoner Evaluation competition is an annual competition (with an associated workshop) that pits OWL 2 compliant reasoners against each other on various standard reasoning tasks over naturally occurring problems. The 2015 competition was the third of its sort and had 14 reasoners competing i...

Full description

Saved in:
Bibliographic Details
Published in:Journal of automated reasoning 2017, Vol.59 (4), p.455-482
Main Authors: Parsia, Bijan, Matentzoglu, Nicolas, Gonçalves, Rafael S., Glimm, Birte, Steigmiller, Andreas
Format: Article
Language:English
Subjects:
Artificial Intelligence
Competition
Computer Science
Mathematical Logic and Formal Languages
Mathematical Logic and Foundations
Symbolic and Algebraic Manipulation
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The OWL Reasoner Evaluation competition is an annual competition (with an associated workshop) that pits OWL 2 compliant reasoners against each other on various standard reasoning tasks over naturally occurring problems. The 2015 competition was the third of its sort and had 14 reasoners competing in six tracks comprising three tasks (consistency, classification, and realisation) over two profiles (OWL 2 DL and EL). In this paper, we discuss the design, execution and results of the 2015 competition with particular attention to lessons learned for benchmarking, comparative experiments, and future competitions.
ISSN:0168-7433
1573-0670
DOI:10.1007/s10817-017-9406-8