提升多模态假信息核查中的证据质量,让大模型更准判断真假。
Beyond Retrieval: Improving Evidence Quality for LLM-based Multimodal Fact-Checking
- 设计新检索策略,扩大外部信息覆盖并过滤无效内容。
- 在两个公开数据集上准确率达88.3%,新出现的假信息准确率90.2%。
- 适合关注大模型假信息检测与证据生成的研究者使用。
日益增多的多模态虚假信息通过文字与图像协同强化误导性主张,对自动化事实核查构成重大挑战。近期研究利用大语言模型(LLMs)进行该任务,借助其强大的推理与多模态理解能力。新兴的检索增强框架进一步为LLMs提供开放域外部信息访问,实现基于证据的验证,超越其内部知识。尽管取得显著进展,我们的实证研究揭示了外部搜索覆盖不足和证据质量评估缺失等明显短板。为此,我们提出Aletheia,一种端到端的自动化多模态事实核查框架。该框架引入一种新型证据检索策略,提升证据覆盖范围并过滤开放域来源中的无用信息,从而提取高质量证据用于验证。大量实验表明,Aletheia在两个公开多模态虚假信息数据集上达到88.3%的准确率,在新出现的假信息上达90.2%。相比现有检索策略,本方法将验证准确率提升最高达30.8%,凸显证据质量在基于LLM的虚假信息验证中的关键作用。
原文摘要 · Abstract (English)
The increasing multimodal disinformation, where deceptive claims are reinforced through coordinated text and visual content, poses significant challenges to automated fact-checking. Recent efforts leverage Large Language Models (LLMs) for this task, capitalizing on their strong reasoning and multimodal understanding capabilities. Emerging retrieval-augmented frameworks further equip LLMs with access to open-domain external information, enabling evidence-based verification beyond their internal knowledge. Despite their promising gains, our empirical study reveals notable shortcomings in the external search coverage and evidence quality evaluation. To mitigate those limitations, we propose Aletheia, an end-to-end framework for automated multimodal fact-checking. It introduces a novel evidence retrieval strategy that improves evidence coverage and filters useless information from open-domain sources, enabling the extraction of high-quality evidence for verification. Extensive experiments demonstrate that Aletheia achieves an accuracy of 88.3% on two public multimodal disinformation datasets and 90.2% on newly emerging claims. Compared with existing evidence retrieval strategies, our approach improves verification accuracy by up to 30.8%, highlighting the critical role of evidence quality in LLM-based disinformation verification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。