一个轻量框架让百万公众号用同一模型生成风格化回复。
One Agent to Serve All: a Lite-Adaptive Stylized AI Assistant for Millions of Multi-Style Official Accounts
- 用动态LoRA模块按风格聚类激活参数,实现轻量适配。
- 在真实工业数据集上,生成质量提升且延迟降低30%以上。
- 适合需要规模化部署、风格多样的官方客服场景。
工业级官方账号平台的对话代理需同时满足上下文准确性和风格一致性,现有方法难以兼顾。思维链提示(CoT)引发显著延迟;按账号微调计算成本过高;长提示方法削弱模型对上下文和风格的理解能力。本文提出WeStar,一种面向百万级官方账号的轻量自适应风格化问答框架。该框架结合检索增强生成(RAG)与参数化检索增强生成(PRAG),通过动态激活每类风格的LoRA模块实现风格感知生成。主要贡献包括:(1) 提出统一框架,支持大规模账号服务且开销极小;(2) 设计多维聚类参数共享机制,紧凑表达风格特征并保留多样性;(3) 提出风格增强的直接偏好优化(SeDPO)方法,优化各风格簇参数以提升生成质量;(4) 在大规模工业数据集上的实验验证了WeStar的有效性与高效性,凸显其实际部署价值。
原文摘要 · Abstract (English)
Conversational agents deployed in industrial-scale official account platforms must generate responses that are both contextually grounded and stylistically aligned-requirements that existing methods struggle to meet. Chain-of-thought (CoT) prompting induces significant latency due to multi-turn reasoning; per-account fine-tuning is computationally prohibitive; and long prompt-based methods degrade the model's ability to grasp injected context and style. In this paper, we propose WeStar, a lite-adaptive framework for stylized contextual question answering that scales to millions of official accounts. WeStar combines context-grounded generation via RAG with style-aware generation using Parametric RAG (PRAG), where LoRA modules are dynamically activated per style cluster. Our contributions are fourfold: (1) We introduce WeStar, a unified framework capable of serving large volumes of official accounts with minimal overhead. (2) We propose a multi-dimensional, cluster-based parameter sharing scheme that enables compact style representation while preserving stylistic diversity. (3) We develop a style-enhanced Direct Preference Optimization (SeDPO) method to optimize each style cluster's parameters for improved generation quality. (4) Experiments on a large-scale industrial dataset validate the effectiveness and efficiency of WeStar, underscoring its pracitical value in real-world deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。