将对话内容与个性化分离,用大模型生成通用回复来指导小模型训练。
GRAG: Generic Response-Augmented Generation Framework for Personalized Conversational Systems
- 用大模型生成的通用回复作骨架,指导小模型在资源受限环境训练。
- 在多个数据集上提升47%的ROUGE-2和36%的BLEU得分。
- 适合需要高个性化又受限于算力或隐私的对话系统部署。
在资源受限或隐私敏感环境中部署高性能个性化对话系统仍面临重大挑战。我们发现现有方法的根本瓶颈在于:当前训练范式将个性化与上下文对齐视为单一整体学习问题。在此范式下,语言模型被迫同时处理‘说什么’(内容对齐)和‘如何说’(个性化),带来显著的计算与优化难题。因此,常出现因追求角色一致性而牺牲上下文对齐,或反之的情况,导致回应要么缺乏对话历史支撑,要么个性化不足。本文提出通用响应增强生成框架(GRAG),通过离线获取大容量通用大模型生成的通用回复,作为语义与结构骨架,引导小型专用模型在资源受限环境下无缝微调。通过解耦内容对齐与个性化,GRAG使模型能专注注入个人特征,同时牢牢锚定对话上下文。我们构建了两种基于后融合与前融合的架构变体,在涵盖多种个性化结构的多个基准对话数据集上评估。结果表明,GRAG显著优于不使用辅助骨架的最先进方法,ROUGE-2提升达47%,BLEU提升36%。最终,GRAG为资源受限环境下构建具备上下文感知的个性化对话系统提供了可泛化的解决方案。
原文摘要 · Abstract (English)
Deploying highly capable personalized conversational agents in resource-constrained or privacy-sensitive environments remains a significant challenge. We identify a fundamental bottleneck in the existing approaches: current training paradigms treat personalization and grounding as a single monolithic learning problem. Under these paradigms, language models are forced to simultaneously address what to say (content grounding) and how to say it in a user-specific way (personalization), which introduces significant computational and optimization challenges. Consequently, contextual grounding is often sacrificed for persona adherence, or vice versa, resulting in responses that are either weakly grounded in the conversational history or insufficiently personalized. In this work, we propose the Generic Response-Augmented Generation (GRAG) framework that decouples these competing objectives by leveraging offline, generic responses from high-capacity, general-purpose LLMs as a semantic and structural scaffold to guide the fine-tuning of smaller, task-specialized models seamlessly in resource-limited environments. By decoupling the content grounding from personalization, GRAG allows the model to focus exclusively on persona injection while remaining firmly anchored to the conversational context. We instantiate the GRAG in two post- and pre-fusion-based architectural variants and evaluate them on multiple benchmark conversational datasets that cover diverse personalization structures. Our results demonstrate that GRAG significantly outperforms state-of-the-art methods that do not use auxiliary scaffolding, yielding up to 47% improvements in ROUGE-2 and 36% in BLEU scores. Ultimately, GRAG offers a generalizable blueprint for building grounding-aware personalized conversational systems in resource-limited environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。