arXiv:2512.02772cs.CLcs.IR2025-12被引 2

统一幻觉检测与事实验证,发现两者互补且融合效果最佳

Towards Unification of Hallucination Detection and Fact Verification for Large Language Models

  • 构建统一评估框架UniFact,实现两类方法的实例级直接对比
  • 实验证明混合方法性能最优,无单一范式始终领先
  • 揭示二者发展分离原因,呼吁建立整合研究新范式

大型语言模型常产生看似流畅但事实错误的内容,严重损害可信度并阻碍实际应用。当前研究形成两种独立范式:以模型为核心的幻觉检测(HD)和以文本为核心的事实验证(FV)。尽管目标一致,二者在假设、数据集和评估协议上长期分离,导致研究割裂。本文提出UniFact统一评估框架,通过动态生成模型输出与对应真实性标签,实现FV与HD的实例级直接比较。大规模实验覆盖多个模型家族与检测方法,发现:(1) 无范式始终更优;(2) HD与FV捕捉事实错误的不同侧面;(3) 融合二者的方法持续达到最优性能。除基准测试外,首次深入分析了二者分化的成因,并提供实证支持其统一必要性。实验结果呼吁建立统一的幻觉检测与事实验证研究新方向。代码、数据及基线已开源。

原文摘要 · Abstract (English)

Large Language Models (LLMs) frequently exhibit hallucinations, generating content that appears fluent and coherent but is factually incorrect. Such errors undermine trust and hinder their adoption in real-world applications. To address this challenge, two distinct research paradigms have emerged: model-centric Hallucination Detection (HD) and text-centric Fact Verification (FV). Despite sharing the same goal, these paradigms have evolved in isolation, using distinct assumptions, datasets, and evaluation protocols. This separation has created a research schism that hinders their collective progress. In this work, we take a decisive step toward bridging this divide. We introduce UniFact, a unified evaluation framework that enables direct, instance-level comparison between FV and HD by dynamically generating model outputs and corresponding factuality labels. Through large-scale experiments across multiple LLM families and detection methods, we reveal three key findings: (1) No paradigm is universally superior; (2) HD and FV capture complementary facets of factual errors; and (3) hybrid approaches that integrate both methods consistently achieve state-of-the-art performance. Beyond benchmarking, we provide the first in-depth analysis of why FV and HD diverged, as well as empirical evidence supporting the need for their unification. The comprehensive experimental results call for a new, integrated research agenda toward unifying Hallucination Detection and Fact Verification in LLMs. We have open-sourced all the code, data, and baseline implementation at: https://github.com/oneal2000/UniFact/

幻觉检测事实验证大模型评估框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。