用语法引导扩散模型提升文本多样性与个性化表达
Syntax-Guided Diffusion Language Models with User-Integrated Personalization
- 先生成语法结构再生成内容,实现结构与语义对齐
- 支持零样本个性化生成,风格还原度高且流畅自然
- 适合需要可控风格输出的对话、创作等场景
大语言模型在生成类人文本方面取得突破,但输出常缺乏结构多样性,限制个性化表达。本文提出一种语法引导的扩散语言模型,通过引入结构监督与个性化条件,提升文本质量、多样性和可控性。设计级联框架先生成语法指导,再进行条件化文本生成,并进一步推广为新型非级联架构,以增强结构与内容的对齐。通过在生成过程中融入语法信息,模型更准确捕捉风格化句法特征。为实现细粒度个性化,提出共享表示机制,促进跨用户信息融合,支持忠实风格生成与可泛化的零样本推理。多任务实验证明该方法在流畅性、多样性和风格保真度上均优于现有方法。定性分析显示其具备良好可解释性与灵活学习个性化模式的能力。
原文摘要 · Abstract (English)
Large language models have made revolutionary progress in generating human-like text, yet their outputs often tend to be generic, exhibiting insufficient structural diversity, which limits personalized expression. Recent advances in diffusion models have opened new opportunities for improving language generation beyond the limitations of autoregressive paradigms. In this work, we propose a syntax-guided diffusion language model that integrates structural supervision and personalized conditioning to enhance text quality, diversity, and controllability. We introduce a cascaded framework that generates syntactic guidance before conditional text generation, and further generalize it to a novel noncascaded architecture for better alignment between structure and content. By incorporating syntactic information in the generating process, the proposed model better captures the lexical and structural characteristics of stylistic sentence construction. To enable fine-grained personalization, we develop a shared representation mechanism that facilitates information integration across users, supporting both faithful stylistic generation and generalizable zero-shot inference. Extensive experiments on multiple tasks demonstrate the superiority of our approach in fluency, diversity, and stylistic fidelity. Further qualitative analyses highlight its interpretability and flexibility in learning personalized patterns.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。