首个覆盖全球事实核查生态的大型数据集,助力研究虚假信息应对机制。
FACTors: A New Dataset for Studying the Fact-checking Ecosystem
- 收集1995-2025年39家认证机构的11.8万条核查报告
- 包含7327条多机构交叉核查的重复声明,覆盖2977个独立事件
- 可分析机构政治倾向与可信度,支持动态更新
为应对网络虚假信息泛滥,自动化事实核查成为关键。现有数据集多局限于局部或短期,缺乏覆盖整个核查生态、时间跨度长且来源多元的数据。本文提出FACTors,首个生态系统级事实核查数据集,涵盖1995至2025年间由39家IFCN和/或EFCSN认证机构发布的117,993份英文核查报告,涉及1,953名个人作者,共118,112条声明。其中7,327条被多个机构核查,对应2,977个唯一声明。该数据集支持开展机构与个体层面的生态研究。我们展示了三项应用:首次对核查生态的统计分析,评估机构政治倾向,并基于分析结果与倾向性构建机构可信度评分。构建方法具有通用性,可实现动态更新。
原文摘要 · Abstract (English)
Our fight against false information is spearheaded by fact-checkers. They investigate the veracity of claims and document their findings as fact-checking reports. With the rapid increase in the amount of false information circulating online, the use of automation in fact-checking processes aims to strengthen this ecosystem by enhancing scalability. Datasets containing fact-checked claims play a key role in developing such automated solutions. However, to the best of our knowledge, there is no fact-checking dataset at the ecosystem level, covering claims from a sufficiently long period of time and sourced from a wide range of actors reflecting the entire ecosystem that admittedly follows widely-accepted codes and principles of fact-checking. We present a new dataset FACTors, the first to fill this gap by presenting ecosystem-level data on fact-checking. It contains 118,112 claims from 117,993 fact-checking reports in English (co-)authored by 1,953 individuals and published during the period of 1995-2025 by 39 fact-checking organisations that are active signatories of the IFCN (International Fact-Checking Network) and/or EFCSN (European Fact-Checking Standards Network). It contains 7,327 overlapping claims investigated by multiple fact-checking organisations, corresponding to 2,977 unique claims. It allows to conduct new ecosystem-level studies of the fact-checkers (organisations and individuals). To demonstrate the usefulness of FACTors, we present three example applications, including a first-of-its-kind statistical analysis of the fact-checking ecosystem, examining the political inclinations of the fact-checking organisations, and attempting to assign a credibility score to each organisation based on the findings of the statistical analysis and political leanings. Our methods for constructing FACTors are generic and can be used to maintain a live dataset that can be updated dynamically.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。