arXiv:2606.20560cs.LGcs.AI2026-06被引 1

DiffusionGemma推理透明度被重新评估,发现其计算过程可解释性接近传统模型。

How Transparent is DiffusionGemma?

论文配图:How Transparent is DiffusionGemma?
图 1 · 摘自论文原文
  • 通过可解释的令牌瓶颈映射中间状态,显著降低不透明串行深度
  • 扩散模型在去噪过程中存在非时间顺序推理等新现象
  • 在监控任务中表现与Gemma 4相当,具备实用透明性

大语言模型推理透明度对理解模型决策、减少误用和调试异常行为至关重要。然而,DiffusionGemma在连续潜在空间中执行更多计算,是否影响其透明性?我们将其分解为变量透明度(能否理解中间计算状态)与算法透明度(能否基于中间状态重构生成过程)。尽管其原始不透明串行深度是自回归Gemma 4的28.6倍,但通过引入可解释的令牌瓶颈,可将不透明串行深度降至仅1.1倍。算法透明度更难实现,因每步去噪可能同时改变所有标记,使模型能实施复杂分布式算法。我们开展一系列可解释性案例研究,首次发现扩散特有现象如非时间顺序推理、标记与序列弥散、中间上下文推理。最后测试可监控性,结果表明DiffusionGemma与Gemma 4在下游任务中具有相似监控能力。

原文摘要 · Abstract (English)

LLM reasoning transparency is a critical affordance for understanding model decisions, mitigating misuse and misalignment, and debugging surprising model behaviors. However, DiffusionGemma performs a larger fraction of its computation in a continuous latent space; does this make its reasoning less transparent? We study this question by decomposing transparency into two components: variable transparency, whether we understand intermediate snapshots of a model's computational state; and algorithmic transparency, whether we can use these snapshots to reconstruct the process by which the model arrived at its outputs. Naively, DiffusionGemma has poor variable transparency: its opaque serial depth, the amount of serial computation that occurs in between interpretable model states, seems at first 28.6X higher than the corresponding autoregressive Gemma 4 model. However, we show that we can map the information flowing between denoising steps through an interpretable token bottleneck with no decrease in downstream performance. Treating these intermediate states as interpretable reduces the opaque serial depth to just 1.1X that of Gemma 4. Algorithmic transparency is harder for diffusion models than for autoregressive models because all token predictions in the canvas can change at every denoising step, giving the model the power to implement complicated distributed algorithms during the denoising process. To begin bridging this gap, we conduct a suite of interpretability case studies, uncovering initial evidence of novel diffusion-specific phenomena such as non-chronological reasoning, token and sequence smearing, and intermediate-context reasoning. Finally, we test monitorability, a key application of transparency that measures whether model outputs are useful for downstream tasks. We find that DiffusionGemma is similarly monitorable to Gemma 4.

扩散模型推理透明度可解释性Gemma

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。