arXiv:2608.08086cs.CL2026-08

提出缓存优化方法Archer,让扩散语言模型推理更快更准。

Archer: Adaptive Reuse of Cached Hidden States for Efficient Rollback in Diffusion Language Models

论文配图:Archer: Adaptive Reuse of Cached Hidden States for Efficient Rollback in Diffusion Language Models
图 1 · 摘自论文原文
  • 仅重用提示部分的缓存状态,响应部分动态更新
  • 平均提速2.57倍,准确率提升至33.63%
  • 适合追求高效高质生成的开发者使用

扩散语言模型(DLMs)通过迭代精炼序列实现回滚能力,但推理成本高。每次去噪更新都会改变全局上下文,导致提示和响应状态均需重算,尽管只有响应可修正。传统键值(KV)缓存假设历史状态不变,难以适配回滚机制。本文提出无需训练的缓存方法Archer:对响应保持同步更新,仅在有限状态邻域内重用提示的K/V。虽然提示表示受双向注意力影响变化,但其词元身份固定,限定范围内的重用可分摊重复计算,且避免临时高置信度错误过早强化,为回滚提供纠错机会。分析表明该策略与可逆性对齐,可界定状态相关近似误差,并给出保留全刷新决策的解码器边际条件。实验显示,Archer在主评测集上实现33.63%的平均性能与2.57倍平均加速,Pass@1最高提升3.05点,最高速度提升达2.95倍。控制分析验证延迟提示反馈带来质量提升,且状态感知刷新有效。代码已开源。

原文摘要 · Abstract (English)

Diffusion language models (DLMs) iteratively refine a sequence, allowing earlier predictions to be revised as context evolves. This rollback capability distinguishes them from irreversible autoregressive generation, but makes inference costly. Every denoising update alters the global context, forcing both prompt and response states to be recomputed even though only response tokens are revisable. Key-value (KV) caching could reduce this cost, yet conventional caching assumes immutable historical states and is therefore difficult to reconcile with rollback. In this paper, we introduce Adaptive Reuse of Cached Hidden States for Efficient Rollback (Archer), a training-free KV caching method for rollback-capable DLMs. Archer asymmetrically keeps the mutable response synchronized with the current hypothesis while reusing prompt K/V within a bounded state neighborhood. Although prompt representations also change under bidirectional attention, their token identities remain fixed; bounded reuse therefore amortizes repeated prompt computation without caching mutable response states. It also delays feedback from tentative tokens, reducing premature reinforcement of transient high-confidence errors and giving rollback more opportunity to correct them. Our analysis characterizes prompt reuse as a reversibility-aligned cache boundary, bounds its state-dependent approximation error, and gives a decoder-margin condition for preserving full-refresh decisions. Existing DLM acceleration often trades quality for speed. Archer shifts this frontier, attaining the best mean performance of 33.63% together with a 2.57x mean speedup on the main suite. Across evaluated settings, it improves Pass@1 by up to 3.05 points and reaches up to 2.95x speedup. Controlled analyses connect the quality gain to delayed prompt feedback and validate state-aware refresh. Our code is available at https://github.com/Hxnng/Archer.

扩散模型推理加速缓存优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。