arXiv:2605.08346cs.CLcs.AI2026-05

提出两种测试方法,揭示大模型推理中幻觉检测的真正依据。

Sanity Checks for Long-Form Hallucination Detection

论文配图:Sanity Checks for Long-Form Hallucination Detection
图 1 · 摘自论文原文
  • 通过替换答案或移除答案步骤,检验检测是否依赖推理过程本身。
  • 去除表面线索后,简单词汇特征仍可实现强鲁棒性检测。
  • 适合关注推理可信度评估与检测机制可解释性的研究者。

大语言模型的幻觉检测越来越多地基于思维链推理轨迹进行,但尚不清楚这些方法评估的是推理过程本身,还是仅利用最终答案的表面特征。本文提出一种受控不变性方法,通过两个理想测试揭示这一区别: extsc{Force} 将每个响应的最终答案替换为真实答案,同时保留推理轨迹; extsc{Remove} 则移除答案宣告步骤,使推理路径保持完整。该方法可判断其预测能力是否源于答案层面的伪信号,而非中间推理结构或有效性。进一步发现,一旦控制这些伪信号,复杂学习表征并非必要:基于词汇轨迹特征(如语气缓和趋势、步骤长度动态、跨响应词汇收敛性)构建的轻量级评分器 TRACT,可在未扰动轨迹上表现优异,甚至优于现有基线。结果表明,当前推理感知幻觉检测的核心挑战并非轨迹中缺乏信号,而是未能将信号从终点提示中分离出来。

原文摘要 · Abstract (English)

Hallucination detection methods for large language models increasingly operate on chain-of-thought reasoning traces, yet it remains unclear whether they evaluate the reasoning itself or merely exploit surface correlates of the final answer. We introduce a controlled-invariance methodology that exposes this distinction through two oracle tests: \textsc{Force}, which replaces each response's final answer with the ground truth while preserving the reasoning trace, and \textsc{Remove}, which strips answer-announcement steps while leaving the trajectory intact. This reveals if their predictive power derives from answer-level artifacts rather than from the structure or validity of intermediate reasoning. We further show that once these artifacts are controlled for, effective detection does not necessarily require complex learned representations: TRACT, a lightweight scorer built on lexical trajectory features (hedging trends, step-length dynamics, and cross-response vocabulary convergence), achieves strong robustness while remaining competitive with or outperforming existing baselines on unperturbed traces. These findings suggest that the current central challenge in reasoning-aware hallucination detection is not the absence of signal in the trace, but the failure to isolate it from endpoint cues.

幻觉检测推理链可解释性轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。