Towards Automated Factchecking: Developing an Annotation Schema and Benchmark for Consistent Automated Claim Detection

Understand

In an effort to assist factcheckers in the process of factchecking, we tackle the claim detection task, one of the necessary stages prior to determining the veracity of a claim.

• It consists of identifying the set of sentences, out of a long text, deemed capable of being factchecked.
• This paper is a collaborative work between Full Fact, an independent factchecking charity, and academic partners.
• Leveraging the expertise of professional factcheckers, we develop an annotation schema and a benchmark for automated claim detection that is more consistent across time, topics and annotators than previous approaches.