Voting-based Methods for Evaluating Sources and Facts Reliability

In this work we propose a family of methods that allow to conjointly compute the reliability of a set of information sources and the confidence of the facts on a set of objects, by confronting the sources points of view. We use a (scoring-based) voting method for the evaluation of the trust of the s...

Full description

Saved in:
Bibliographic Details
Main Authors: Elsaesser, Quentin, Everaere, Patricia, Konieczny, Sebastien
Format: Conference Proceeding
Language:English
Subjects:
Artificial intelligence
Benchmark testing
Multi-agent systems
Reliability
Reliability theory
Task analysis
Trust
Truth Tracking
Voting
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this work we propose a family of methods that allow to conjointly compute the reliability of a set of information sources and the confidence of the facts on a set of objects, by confronting the sources points of view. We use a (scoring-based) voting method for the evaluation of the trust of the sources, using Condorcet's Jury Theorem arguments in order to identify the truth and the reliable sources. We discuss general theoretical properties that such operators should satisfy, and we study what are the properties satisfied by our methods. We provide an experimental study that shows that we perform better than state of the art methods on the task of finding the truth among the possible facts. We show that we can also adequately evaluate the reliability of the sources of information.
ISSN:2375-0197
DOI:10.1109/ICTAI59109.2023.00034