arXiv:2511.09292cs.CLcs.AI2025-11中稿 · AAAI

让大模型同时精准控制多种文本属性,还能自动解决冲突。

C$^3$TG: Conflict-aware, Composite, and Collaborative Controlled Text Generation

  • 分两阶段控制:生成时选分类器加权调整,优化时用能量函数迭代修正。
  • 在17个维度上同时提升属性准确率与文本流畅度,毒性降低30%以上。
  • 适合需要多属性协同控制的场景,如内容安全、个性化生成。

大型语言模型在文本生成方面取得了显著进展,但精确控制生成文本的特定属性仍面临挑战,尤其在不修改架构或大量微调的前提下。现有方法通常仅能切换单一基础属性,难以实现多属性精确控制。当属性需求存在冲突时,现有方法缺乏协调机制,导致属性间相互干扰。此外,这些方法未将迭代优化过程融入生成流程。为此,我们提出冲突感知、复合式与协作式可控文本生成(C³TG),一个两阶段框架,实现细粒度、多维度的文本属性控制。生成阶段,C³TG从17个可用维度中选择对应的属性分类器,通过加权KL散度调整词元概率;优化阶段则利用结合分类器得分与惩罚项的能量函数,通过迭代反馈解决属性冲突,实现多维度同步精准控制,同时保持文本自然流畅。实验表明,C³TG在属性准确性、语言流畅性、输出多样性等多项指标上显著优于基线,同时降低毒性。结果证明,C³TG是一种无需昂贵模型修改的有效且灵活的多维属性控制方案。

原文摘要 · Abstract (English)

Recent advancements in large language models (LLMs) have demonstrated remarkable text generation capabilities. However, controlling specific attributes of generated text remains challenging without architectural modifications or extensive fine-tuning. Current methods typically toggle a single, basic attribute but struggle with precise multi-attribute control. In scenarios where attribute requirements conflict, existing methods lack coordination mechanisms, causing interference between desired attributes. Furthermore, these methods fail to incorporate iterative optimization processes in the controlled generation pipeline. To address these limitations, we propose Conflict-aware, Composite, and Collaborative Controlled Text Generation (C$^3$TG), a two-phase framework for fine-grained, multi-dimensional text attribute control. During generation, C$^3$TG selectively pairs the LLM with the required attribute classifiers from the 17 available dimensions and employs weighted KL-divergence to adjust token probabilities. The optimization phase then leverages an energy function combining classifier scores and penalty terms to resolve attribute conflicts through iterative feedback, enabling precise control over multiple dimensions simultaneously while preserving natural text flow. Experiments show that C$^3$TG significantly outperforms baselines across multiple metrics including attribute accuracy, linguistic fluency, and output diversity, while simultaneously reducing toxicity. These results establish C$^3$TG as an effective and flexible solution for multi-dimensional text attribute control that requires no costly model modifications.

文本生成多属性控制大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。