arXiv:2607.01893cs.AIcs.CL2026-07

改进块生成器的训练方式,让推理时更长的文本被接受。

Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters

论文配图:Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters
图 1 · 摘自论文原文
  • 用首次失败位置限定损失范围,聚焦于实际被采纳的前缀。
  • 在六个基准上平均生成长度从2.40提升至2.61,全部提升。
  • 无需修改推理流程或额外目标,适配现有系统部署。

推测解码通过并行生成一整块标记由目标模型逐个验证,仅保留最长有效前缀来加速自回归生成。块式(DLM风格)生成器并行预测整块内容,速度快但训练时使用全块交叉熵损失,对每个位置都监督其与真实延续匹配——尽管推理中会丢弃首个拒绝之后的所有标记。近期方法通过重新加权损失来缓解此问题;本文则以教师强制学习为启发,提出将监督集中于被接受的前缀。由于仅掩码的块生成器无输入侧真实前缀条件,AUF在损失端通过仅保留生成器首次预测失败位置之前的交叉熵支持,近似实现前缀敏感监督。AUF是仅改变交叉熵支持范围的独立调整,无需辅助目标、无需验证器回滚,也不改动推理流程或精确性约定。在Qwen3-8B固定生成器骨干与服务设置下,AUF使DFlash生成器的平均输出长度τ在六项基准上从2.40提升至2.61,每项均提升,并成功迁移到Domino双分支头(2.56→2.68)。两个发现进一步明确:仅衰减基线虽在共享块掩码上获得更高标记准确率,但解码表现更差;在DFlash上,一旦AUF截断支持范围,标准指数位置衰减权重实则失效。

原文摘要 · Abstract (English)

Speculative decoding accelerates autoregressive generation by drafting a block of tokens that the target model verifies left-to-right, committing only the longest accepted prefix. Block (DLM-style) drafters predict the whole block in parallel, which is fast but trained with a full-block cross-entropy that supervises every position against the gold continuation -- even though inference discards every token after the first rejection. Recent acceptance-aware objectives patch this by reweighting the full-block loss; we instead use teacher-forced learning as a motivation for how supervision should concentrate on the accepted prefix. A mask-only block drafter has no input-side channel for gold-prefix conditioning, so AUF approximates that prefix-sensitive supervision on the loss side by keeping the cross-entropy support only through the drafter's first predicted failure. AUF is a single, detached change to the CE support -- no auxiliary objective, no verifier rollouts, and no change to the inference pipeline or the exactness contract. Within fixed drafter backbones and serving settings on Qwen3-8B, AUF raises the DFlash drafter's average emitted length $τ$, averaged over six benchmarks, from 2.40 to 2.61, with a gain on every benchmark, and transfers to Domino's two-branch head (2.56 to 2.68). Two findings sharpen the picture: the decay-only baseline reaches higher token accuracy on the shared block mask yet decodes worse, and on DFlash, once AUF truncates the support, the standard exponential position-decay weighting becomes empirically inert.

生成优化推理加速训练策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。