小模型自信但不准,大模型准却不自信,揭示AI事实核查的可信度悖论
Scaling Truth: The Confidence Paradox in AI Fact-Checking
- 对比9种主流LLM在多语言、跨时间跨度上的表现,模拟真实查证场景
- 小模型准确率仅52%却信心超80%,大模型准确率达76%但信心不足60%
- 研究揭示了技术资源不平等对全球信息公平的深层影响,适合政策与AI伦理研究者
虚假信息的蔓延凸显了可扩展且可靠的自动事实核查需求。大型语言模型(LLMs)有望实现自动化验证,但在全球语境下的有效性仍存疑。我们系统评估了九种成熟LLM在多个类别(开源/闭源、不同规模、多样架构、基于推理)的表现,使用了5,000条由174家专业事实核查机构在47种语言中验证过的声明。方法涵盖模型在训练截止日期之后的声明上的泛化能力测试,以及四种模仿普通公众和专业核查员交互的提示策略,共生成超过24万条人工标注作为真实标签。结果揭示了一种类似达克效应的现象:小型、易获取的模型表现出高置信度但准确率较低,而大型模型虽准确率更高但置信度更低。这可能导致信息验证中的系统性偏见,因为资源受限的组织通常依赖小型模型。性能差距在非英语语言及来自全球南方的声明中尤为显著,加剧现有信息不平等。本研究建立了多语言基准,为未来研究提供实证基础,并为确保可信、公平的AI辅助事实核查政策提供依据。
原文摘要 · Abstract (English)
The rise of misinformation underscores the need for scalable and reliable fact-checking solutions. Large language models (LLMs) hold promise in automating fact verification, yet their effectiveness across global contexts remains uncertain. We systematically evaluate nine established LLMs across multiple categories (open/closed-source, multiple sizes, diverse architectures, reasoning-based) using 5,000 claims previously assessed by 174 professional fact-checking organizations across 47 languages. Our methodology tests model generalizability on claims postdating training cutoffs and four prompting strategies mirroring both citizen and professional fact-checker interactions, with over 240,000 human annotations as ground truth. Findings reveal a concerning pattern resembling the Dunning-Kruger effect: smaller, accessible models show high confidence despite lower accuracy, while larger models demonstrate higher accuracy but lower confidence. This risks systemic bias in information verification, as resource-constrained organizations typically use smaller models. Performance gaps are most pronounced for non-English languages and claims originating from the Global South, threatening to widen existing information inequalities. These results establish a multilingual benchmark for future research and provide an evidence base for policy aimed at ensuring equitable access to trustworthy, AI-assisted fact-checking.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。