arXiv:2603.05471cs.CLcs.AI2026-03被引 1

不依赖外部检索,用大模型内部知识实现更可靠的文本真实性验证。

Leveraging LLM Parametric Knowledge for Fact Checking without Retrieval

  • 利用模型内部表示而非外部检索进行事实核查
  • 在9个数据集上超越现有方法,尤其擅长长尾知识和多语言场景
  • 适合需要高效、自洽验证的生成式AI系统或训练奖励信号

可信度是基于大语言模型构建的智能体系统的核心研究挑战。为提升可信度,通常通过检索外部知识并用大模型验证声明与证据的一致性来检查自然语言声明的真实性。然而,此类方法受限于检索误差和外部数据可用性,且未充分挖掘模型内在的事实验证能力。本文提出无检索事实核查任务,专注于独立于来源的任意自然语言声明验证。为此,我们构建了一个综合性评估框架,重点考察泛化能力,涵盖(i)长尾知识、(ii)声明来源差异、(iii)多语言性、(iv)长文本生成。在9个数据集、18种方法和3个模型上的实验表明,基于逻辑值的方法常表现不佳,而利用内部模型表示的方法更优。基于此发现,我们提出INTRA方法,通过内部表示间的交互实现当前最优性能,并具备强泛化能力。本工作确立了无检索事实核查作为有前景的研究方向,可补充检索式框架、提升可扩展性,并支持在训练中作为奖励信号或生成过程中的组件使用。

原文摘要 · Abstract (English)

Trustworthiness is a core research challenge for agentic AI systems built on Large Language Models (LLMs). To enhance trust, natural language claims from diverse sources, including human-written text, web content, and model outputs, are commonly checked for factuality by retrieving external knowledge and using an LLM to verify the faithfulness of claims to the retrieved evidence. As a result, such methods are constrained by retrieval errors and external data availability, while leaving the models intrinsic fact-verification capabilities largely unused. We propose the task of fact-checking without retrieval, focusing on the verification of arbitrary natural language claims, independent of their source. To study this setting, we introduce a comprehensive evaluation framework focused on generalization, testing robustness to (i) long-tail knowledge, (ii) variation in claim sources, (iii) multilinguality, and (iv) long-form generation. Across 9 datasets, 18 methods and 3 models, our experiments indicate that logit-based approaches often underperform compared to those that leverage internal model representations. Building on this finding, we introduce INTRA, a method that exploits interactions between internal representations and achieves state-of-the-art performance with strong generalization. More broadly, our work establishes fact-checking without retrieval as a promising research direction that can complement retrieval-based frameworks, improve scalability, and enable the use of such systems as reward signals during training or as components integrated into the generation process.

事实核查大模型无检索生成可信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。