Towards Better Evidence Extraction Methods for Fact-Checking Systems

• Type: Article in International Conference Proceedings Book
• Date: 2021

Authors

Azevedo, P (Author) Other; Rocha, G (Author) Other; Esteves, D (Author) Other; Henrique Lopes Cardoso (Author) FEUP

Conference proceedings International

Title: WI-IAT '21: IEEE/WIC/ACM International Conference on Web Intelligence, Melbourne VIC Australia, December 14 - 17, 2021

Pages: 277-284

2021 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, WI-IAT 2021

14 December 2021 through 17 December 2021

Indexing

Scopus

Other information

Authenticus ID: P-00W-EYB

DOI: 10.1145/3486622.3493930

Abstract (EN): Given current levels of misinformation spread, never before have fact-checking frameworks been so critical. Unfortunately, the performance of Automated Fact-checking systems is still poor due to the complexity of the task. In this paper, we present an ablation study of a framework submitted to the FEVER 1.0 challenge. Based on our findings, we explore how triple-based information retrieval, coreference resolution, and recent language model representations can impact the performance of each subtask. We show the importance of recall and precision in the retrieval of documents and sentences that can be provided to justify the veracity of a given claim. We reach state-of-the-art results in the Document Retrieval task and we show promising results when using coreference resolution to improve the Sentence Retrieval task. © 2021 Owner/Author.

Language: English

Type (Professor's evaluation): Scientific