构建首个中文长期对话个性化数据集,提升智能助手记忆与个性化能力
Mem-PAL: Towards Memory-based Personalized Dialogue Assistants for Long-term User-Agent Interaction
- 设计分层异构记忆框架,融合检索增强生成技术
- 在自建与外部数据集上验证,显著提升个性化响应效果
- 适合研究长期交互、个性化对话系统的学者与开发者
随着智能个人设备的普及,面向服务的人机交互日益频繁。这要求对话助手能理解用户特性和偏好以精准回应。然而现有方法常忽视长期交互复杂性,难以捕捉用户主观特征。为此,我们提出PAL-Bench基准,用于评估服务型助手在长期交互中的个性化能力。由于缺乏真实数据,我们构建了基于大语言模型的多步合成流程,并经人工标注验证与优化,形成PAL-Set——首个包含多轮会话日志和对话历史的中文数据集,构成PAL-Bench基础。此外,为提升个性化服务交互,我们提出H²Memory框架,采用分层异构记忆结构并结合检索增强生成技术,有效改进个性化回复生成。在PAL-Bench及外部数据集上的综合实验表明该框架有效性。
原文摘要 · Abstract (English)
With the rise of smart personal devices, service-oriented human-agent interactions have become increasingly prevalent. This trend highlights the need for personalized dialogue assistants that can understand user-specific traits to accurately interpret requirements and tailor responses to individual preferences. However, existing approaches often overlook the complexities of long-term interactions and fail to capture users' subjective characteristics. To address these gaps, we present PAL-Bench, a new benchmark designed to evaluate the personalization capabilities of service-oriented assistants in long-term user-agent interactions. In the absence of available real-world data, we develop a multi-step LLM-based synthesis pipeline, which is further verified and refined by human annotators. This process yields PAL-Set, the first Chinese dataset comprising multi-session user logs and dialogue histories, which serves as the foundation for PAL-Bench. Furthermore, to improve personalized service-oriented interactions, we propose H$^2$Memory, a hierarchical and heterogeneous memory framework that incorporates retrieval-augmented generation to improve personalized response generation. Comprehensive experiments on both our PAL-Bench and an external dataset demonstrate the effectiveness of the proposed memory framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。