arXiv:2608.14632cs.CLcs.AI2026-08

将去噪轨迹建模为多变量时间序列,提升扩散语言模型幻觉检测能力

DeMTS: Denoising Trajectories as Multivariate Time Series for Hallucination Detection in Diffusion Language Models

论文配图:DeMTS: Denoising Trajectories as Multivariate Time Series for Hallucination Detection in Diffusion Language Models
图 1 · 摘自论文原文
  • 把去噪过程的二维轨迹转化为可学习的隐变量序列
  • 在三个基准上显著优于现有方法,准确率提升超过5%
  • 适合关注生成内容可靠性与模型可信性的研究者

扩散大语言模型(D-LLMs)虽具潜力,但仍存在幻觉问题,即生成内容看似流畅却事实错误。现有检测方法通常压缩轨迹数据,忽略完整的二维标记-步骤结构,难以捕捉不一致收敛和跨标记错误传播等模式。为此,我们提出DeMTS框架,将去噪轨迹建模为可学习隐变量的多变量时间序列。通过保留轨迹结构的标记-变量映射模块,构建动态多变量时序模型,逐步融合变量间依赖与时间编码以预测幻觉。在两个D-LLM主干和三个基准上的实验证明,DeMTS在性能、鲁棒性、效率和跨任务迁移方面均超越现有方法。

原文摘要 · Abstract (English)

Diffusion large language models (D-LLMs) have emerged as a promising paradigm for text generation. However, similar to autoregressive LLMs, D-LLMs remain vulnerable to hallucinations, where fluent outputs may contain factually incorrect or unsupported content. Although existing hallucination detection methods for D-LLMs attempt to leverage uncertainty trajectories of the denoising process to better identify hallucination signals, they typically compress the trajectories along either the temporal or token dimension, overlooking the useful information encoded in the complete two-dimensional token-step structure. Consequently, they may fail to capture hallucination-relevant patterns, such as inconsistent convergence and cross-token fault propagation, leading to suboptimal detection performance. To bridge this gap, we propose a D-LLM hallucination detection framework that formulates the Denoising trajectories as Multivariate Time Series over learnable latent variables (DeMTS for short). DeMTS employs a trajectory-preserving token-to-variable assignment module to convert token signals into stable latent variables. Based on these variables, we propose dynamic multivariate temporal modeling to progressively integrate inter-variable dependency modeling with temporal encoding for hallucination prediction. Extensive experiments on two D-LLMs backbones and three benchmarks demonstrate that DeMTS outperforms existing hallucination detection methods while maintaining strong robustness, efficiency, and cross-task transferability.

幻觉检测扩散模型时序建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。