arXiv:2505.14455cs.CLcs.AI2025-05被引 18

让扩散语言模型自动调整生成块大小,实现更灵活可控的文本生成。

CtrlDiff: Boosting Large Diffusion Language Models with Dynamic Block Prediction and Controllable Generation

  • 用强化学习动态决定每块生成长度,适应不同语义复杂度。
  • 引入分类器引导机制,零成本实现条件生成,计算开销小。
  • 在多种任务上表现接近自回归模型,适合需要精细控制的场景。

尽管自回归模型近年主导语言建模,但基于扩散的模型因其并行生成能力和天然可编辑性成为有吸引力的替代方案。然而,现有模型受限于固定长度输出,且缺乏灵活控制机制。本文提出CtrlDiff,一种动态可调控的半自回归框架:通过强化学习根据局部语义自适应调整生成块大小;设计针对离散扩散的分类器引导控制机制,在不重新训练的前提下高效实现后置条件生成,显著降低计算开销。大量实验表明,CtrlDiff在混合扩散模型中达到新标杆,缩小与顶尖自回归方法的性能差距,并在多类任务中实现有效条件生成。

原文摘要 · Abstract (English)

Although autoregressive models have dominated language modeling in recent years, there has been a growing interest in exploring alternative paradigms to the conventional next-token prediction framework. Diffusion-based language models have emerged as a compelling alternative due to their powerful parallel generation capabilities and inherent editability. However, these models are often constrained by fixed-length generation. A promising direction is to combine the strengths of both paradigms, segmenting sequences into blocks, modeling autoregressive dependencies across blocks while leveraging discrete diffusion to estimate the conditional distribution within each block given the preceding context. Nevertheless, their practical application is often hindered by two key limitations: rigid fixed-length outputs and a lack of flexible control mechanisms. In this work, we address the critical limitations of fixed granularity and weak controllability in current large diffusion language models. We propose CtrlDiff, a dynamic and controllable semi-autoregressive framework that adaptively determines the size of each generation block based on local semantics using reinforcement learning. Furthermore, we introduce a classifier-guided control mechanism tailored to discrete diffusion, which significantly reduces computational overhead while facilitating efficient post-hoc conditioning without retraining. Extensive experiments demonstrate that CtrlDiff sets a new standard among hybrid diffusion models, narrows the performance gap to state-of-the-art autoregressive approaches, and enables effective conditional text generation across diverse tasks.

扩散模型文本生成可控生成自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。