arXiv:2607.22661cs.AI2026-07

无需训练即可检测扩散语言模型幻觉,仅凭一次生成就判断可信度。

TRE: Training-Free Hallucination Detection for Diffusion Language Models

论文配图:TRE: Training-Free Hallucination Detection for Diffusion Language Models
图 1 · 摘自论文原文
  • 基于单次生成的熵信号,从空间和时间维度捕捉幻觉风险。
  • 在多个模型和数据集上表现媲美训练型方法,且无需额外训练。
  • 适合追求高效、通用幻觉检测的开发者与研究者使用。

扩散大语言模型(D-LLMs)近年来受到广泛关注,但其可靠性严重受限于幻觉问题。现有检测方法多依赖数据驱动的训练范式,不仅降低跨领域泛化能力,还带来额外训练成本与部署开销。为此,我们提出 TRE——一种无需训练的扩散语言模型幻觉检测指标。TRE 是无参数、单次运行的度量,直接从单次生成过程中的熵信号估计幻觉风险,无需训练或重复采样。TRE 在解码过程中沿空间和时间维度提取熵信号:从标记级空间视角,关注最具信息量的标记以揭示不确定性所在;从扩散步级时间视角,实证发现晚期步骤熵占主导,采用简单线性加权聚合获得 TRE。在多个 D-LLM 和问答数据集上的实验表明,TRE 实现了具有竞争力的性能,同时具备强泛化性、高效性与鲁棒性。

原文摘要 · Abstract (English)

Diffusion large language models (D-LLMs) have recently gained increasing attention, yet their reliability is significantly hindered by the hallucination problem. Existing hallucination detection approaches for D-LLMs mainly follow a training-based paradigm, relying on data-driven training to optimize the detector. Such reliance not only limits their generalizability across domains models but also incurs additional training cost and deployment overhead. To address these limitations, we propose TRE, a training-free hallucination detection metric for D-LLMs. TRE is a parameter-free and single-run metric that estimates hallucination risk directly from the entropy signals of a single generation, without requiring any detector training or repeated sampling. TRE extracts entropy signals within the D-LLM decoding process along both the spatial and temporal dimensions. From a token-level spatial perspective, we focus on revealing tokens as the most informative carriers of uncertainty, capturing where uncertainty is actively committed. From a diffusion step-level temporal perspective, we empirically identify the dominance of late-step entropy and hence aggregate these signals with a simple linear weighting scheme to obtain TRE. Extensive experiments on multiple D-LLMs and QA datasets demonstrate that TRE achieves competitive performance, while enjoying strong generalizability, efficiency, and robustness.

幻觉检测扩散模型无训练熵分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。