arXiv:2510.06386cs.CL2025-10被引 2

无需分类器即可高效控制文本风格,提升生成质量与速度。

Controllable Stylistic Text Generation with Train-Time Attribute-Regularized Diffusion

  • 训练时注入属性特征,推理时无需分类器,降低计算开销。
  • 在五个数据集上优于主流基线,实现更精准的风格控制。
  • 适合需要高效可控文本生成的研究者与应用开发者。

可控文本生成中对特定风格属性的精确控制是关键挑战。近年来,扩散模型在图文生成中表现突出。现有方法分为无分类器引导(CFG)和有分类器引导(CG)两类:CFG虽能保持语义连贯性,但属性控制能力弱;CG通过分类器梯度调整去噪路径,虽属性对齐更好,但采样成本高且泛化能力差。本文提出RegDiff,一种基于属性正则化的扩散框架,在推理阶段无需预训练分类器即可实现可控生成,显著降低计算开销。该方法采用基于VAE的编码器-解码器结构保障重建保真度,并使用带属性监督的潜空间扩散模型实现风格可控生成,属性信息仅在训练阶段注入。在涵盖多种风格属性的五个数据集上的实验表明,RegDiff显著优于强基线,验证了其作为高效属性可控文本生成方案的有效性。代码、数据集及资源将于发表后公开于https://github.com/xxxx。

原文摘要 · Abstract (English)

Generating stylistic text with specific attributes is a key problem in controllable text generation. Recently, diffusion models have emerged as a powerful paradigm for both visual and textual generation. Existing approaches can be broadly categorized into classifier-free guidance (CFG) and classifier guidance (CG) methods. While CFG effectively preserves semantic content, it often fails to provide effective attribute control. In contrast, CG modifies the denoising trajectory using classifier gradients, enabling better attribute alignment but incurring high computational costs during sampling and suffering from classifier generalization issues. In this work, we propose RegDiff, a regularized diffusion framework that leverages attribute features without requiring a pretrained classifier during sampling, thereby achieving controllable generation with reduced computational costs. Specifically, RegDiff employs a VAE-based encoder--decoder architecture to ensure reconstruction fidelity and a latent diffusion model trained with attribute supervision to enable controllable text generation. Attribute information is injected only during training. Experiments on five datasets spanning multiple stylistic attributes demonstrate that RegDiff outperforms strong baselines in generating stylistic texts. These results validate the effectiveness of RegDiff as an efficient solution for attribute-controllable text diffusion. Our code, datasets, and resources will be released upon publication at https://github.com/xxxx.

文本生成扩散模型风格控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。