arXiv:2605.10971cs.LGcs.AI2026-05

提出自适应调度器,让离散扩散语言模型精准控制文本属性而不降质。

Steering Without Breaking: Mechanistically Informed Interventions for Discrete Diffusion Language Models

论文配图:Steering Without Breaking: Mechanistically Informed Interventions for Discrete Diffusion Language Models
图 1 · 摘自论文原文
  • 按属性形成时机动态调整干预时机,避免无效操作。
  • 多属性联合控制时达93%强度,优于基线15个百分点。
  • 适用于需精细调控文本内容的生成场景。

离散扩散语言模型(DLMs)通过并行去噪生成文本,是自回归模型的替代方案。现有控制生成方法从自回归模型移植而来,在每个去噪步骤施加统一干预,但研究发现这种策略会损害生成质量,尤其在多属性联合控制时问题加剧。通过在四个DLMs(参数量124M-8B)上训练稀疏自编码器,我们发现不同属性的承诺(commitment)存在显著差异:例如主题在前2%去噪阶段完成,而情感则在20%过程中逐步显现。因此,统一干预会在属性已固化或尚未出现的步骤上浪费资源。为此,我们提出一种新型自适应调度器,仅在属性活跃形成阶段施加干预,其余阶段保持不变。该方法的代价-控制权衡可由承诺分布的单一离散度统计量刻画。在四个DLMs和七个控制任务中,本方法实现了无降质的精确控制;在挑战性的三属性联合控制中,最高达到93%的控制强度,相比最强基线提升最多15个百分点,同时保持生成质量。

原文摘要 · Abstract (English)

Discrete diffusion language models (DLMs) generate text by iteratively denoising all positions in parallel, offering an alternative to autoregressive models. Controlled generation methods for DLMs, imported from autoregressive models, apply uniform intervention at every denoising steps. We show this uniform schedule degrades quality, and the damage compounds when multiple attributes are steered jointly. To diagnose the failure, we train sparse autoencoders on four DLMs (124M-8B parameters) and find that different attributes commit on distinct schedules, varying in timing, sharpness, and magnitude. For instance, topic commits within the first 2\% of denoising, whereas sentiment emerges gradually over 20\% of the process. Consequently, uniform intervention wastes steering capacity on steps where the target attribute has already solidified or has yet to emerge. We propose a novel adaptive scheduler that concentrates interventions on the steps where an attribute is actively forming and leaves the rest of generation untouched. The cost-control trade-off admits a closed-form characterization: the advantage of adaptive over uniform scheduling is governed by a single dispersion statistic of the commitment distribution. Across four DLMs and seven steering tasks, our method achieves precise control without the degradation typical of uniform interventions. Especially on challenging simultaneous three-attribute control, it reaches up to 93\% steering strength, beating the strongest baseline by up to 15\% points while preserving generation quality.

扩散模型文本生成可控生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。