Fact-checking: relevance assessment of references in the Polish political domain

The prevalence of fake news could be observed in circumstances of emotion-causing events, like elections or pandemics. In fear of the potential impact, many fact-checking organisations were established. However, fact-checking requires a large amount of human labor, and hence there is a strong demand...

Full description

Saved in:
Bibliographic Details
Published in:Procedia computer science 2021, Vol.192, p.1285-1293
Main Authors: Sawczyn, Albert, Binkowski, Jakub, Janiak, Denis, Augustyniak, Łukasz, Kajdanowicz, Tomasz
Format: Article
Language:English
Subjects:
deep learning
fact-checking
fake news
information retrieval
language modelling
natural language processing
relevance assessment
transformers
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The prevalence of fake news could be observed in circumstances of emotion-causing events, like elections or pandemics. In fear of the potential impact, many fact-checking organisations were established. However, fact-checking requires a large amount of human labor, and hence there is a strong demand for complete automation of this process. Nevertheless, this milestone has not been achieved yet, even for English. The problem grows for the less popular languages that suffer from a scarcity of available resources. To address this problem for the Polish language domain, we propose a solution for automating one of the fact-checking stages - relevance assessment, which is crucial when searching for evidence. Leveraging recent advancements in natural language processing, we have acquired relevant data and developed classifiers of evidence relevance with respect to claims in Polish. Our approach can assess the evidence relevance with a performance at a level of a 0.778 F1-score.
ISSN:1877-0509
1877-0509
DOI:10.1016/j.procs.2021.08.132