用可解释的潜变量实现对话风格、互动模式与人格的精细控制
V-VAE: A Variational Auto Encoding Framework Towards Fine-Grained Control over Human-Like Chat
- 通过变分自编码框架动态建模对话中的细微特质
- 在两个基准上优于标准基线,证明控制效果提升
- 适合需要个性化、拟人化交互的聊天系统开发者
随着基于大语言模型的聊天机器人持续发展,人们越来越希望生成不仅语言流畅,且在对话中稳定体现特定人物特征的回复。然而,现有角色扮演和基于人物特征的对话方法严重依赖静态角色描述、粗粒度信号空间及低质量合成数据,难以捕捉人类对话中的动态细微特征。真实的人类对话需要建模情感基调、情境意识和不断变化的人格等隐含特质,这些难以预先定义,也难以从合成或蒸馏数据中学习。为此,我们提出一种口语化变分自编码(V-VAE)框架,包含变分自编码模块与细粒度控制空间,能根据对话风格、互动模式和个人属性等可解释的潜变量动态调整对话行为。我们还构建了高质量数据集 HumanChatData 及基准 HumanChatBench,以缓解人类对话领域高质量数据稀缺的问题。实验表明,基于 V-VAE 的大语言模型在 HumanChatBench 与 DialogBench 上均持续优于标准基线,进一步验证了 V-VAE 与 HumanChatData 的有效性。
原文摘要 · Abstract (English)
With the continued proliferation of Large Language Model (LLM) based chatbots, there is a growing demand for generating responses that are not only linguistically fluent but also consistently aligned with persona-specific traits in conversations. However, existing role-play and persona-based chat approaches rely heavily on static role descriptions, coarse-grained signal space, and low-quality synthetic data, which fail to capture dynamic fine-grained details in human-like chat. Human-like chat requires modeling subtle latent traits, such as emotional tone, situational awareness, and evolving personality, which are difficult to predefine and cannot be easily learned from synthetic or distillation-based data. To address these limitations, we propose a Verbal Variational Auto-Encoding (V-VAE) framework, containing a variational auto-encoding module and fine-grained control space which dynamically adapts dialogue behaviour based on fine-grained, interpretable latent variables across talking style, interaction patterns, and personal attributes. We also construct a high-quality dataset, HumanChatData, and benchmark HumanChatBench to address the scarcity of high-quality data in the human-like domain. Experiments show that LLMs based on V-VAE consistently outperform standard baselines on HumanChatBench and DialogBench, which further demonstrates the effectiveness of V-VAE and HumanChatData.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。