arXiv:2409.00887cs.CLcs.AI2024-09被引 3

用用户画像增强对话模型,小数据也能精准复现真实用户说话风格。

User-Specific Dialogue Generation with User Profile-Aware Pre-Training Model and Parameter-Efficient Fine-Tuning

  • 结合用户画像预训练与参数高效微调,提升小样本下个性化对话能力。
  • 在仅用少量对话历史时,生成结果对真实用户的还原度更高。
  • 适合需要高保真个性化交互的应用,如客服、虚拟助手。

本文研究用户特定对话生成。与以往聚焦于基于角色设定的个性化对话不同,用户特定对话旨在复现真实用户的对话行为,超越基于角色描述的生成。利用目标用户的对话历史进行微调是构建用户特定模型的有效方法,但因数据量少,易导致过拟合和模型崩溃。为此,我们提出一种结合用户画像感知预训练模型与参数高效微调的学习方法。参数高效微调仅添加少量新参数,即使数据量小也能高效训练并抵御模型崩溃。此外,通过简单提示自动推断用户画像进行预训练的模型,在微调阶段数据稀缺时仍能生成具备用户特征知识的对话。实验表明,相较于使用用户个人信息提示的大语言模型生成方式,所提模型在复现真实用户语句方面表现更优,且在小模型情况下仍具高还原性。

原文摘要 · Abstract (English)

This paper addresses user-specific dialogs. In contrast to previous research on personalized dialogue focused on achieving virtual user dialogue as defined by persona descriptions, user-specific dialogue aims to reproduce real-user dialogue beyond persona-based dialogue. Fine-tuning using the target user's dialogue history is an efficient learning method for a user-specific model. However, it is prone to overfitting and model destruction due to the small amount of data. Therefore, we propose a learning method for user-specific models by combining parameter-efficient fine-tuning with a pre-trained dialogue model that includes user profiles. Parameter-efficient fine-tuning adds a small number of parameters to the entire model, so even small amounts of training data can be trained efficiently and are robust to model destruction. In addition, the pre-trained model, which is learned by adding simple prompts for automatically inferred user profiles, can generate speech with enhanced knowledge of the user's profile, even when there is little training data during fine-tuning. In experiments, we compared the proposed model with large-language-model utterance generation using prompts containing users' personal information. Experiments reproducing real users' utterances revealed that the proposed model can generate utterances with higher reproducibility than the compared methods, even with a small model.

对话生成用户画像小样本参数高效

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。