arXiv:2608.16168cs.CLcs.AI2026-08

让大模型更懂用户长期变化的偏好,通过分段记忆精准推理用户状态。

QUMem: Personalized Memory for Query-Conditioned User-State Inference in LLM Agents

论文配图:QUMem: Personalized Memory for Query-Conditioned User-State Inference in LLM Agents
图 1 · 摘自论文原文
  • 按语义连续性分段对话历史,拆解为事实、偏好、洞察三类独立记忆。
  • 在测试中超越现有方法,在PersonaMem和KnowU-Bench上均达最优表现。
  • 适合需要长期个性化交互的智能助手、客服机器人等场景。

大型语言模型代理越来越多地依赖外部记忆系统来实现个性化,基于长期且不断演变的交互历史。然而,现有系统存在三大局限:固定轮次、固定长度或会话边界会混淆无关对话或割裂事件的前因后果;将同一交互中的多个用户信息合并为单一记忆,导致功能不同的条目被捆绑,难以独立检索;将当前任务视为单一top-k检索查询,可能返回虽各自相关但无法共同捕捉偏好演化、时间有效性与上下文适用性的碎片。我们提出QUMem,一种面向查询条件化用户状态推理的结构化记忆框架。QUMem首先根据语义连续性将交互历史划分为可变长度的片段,再将每个片段分解为可独立检索的事实、偏好与可迁移洞察三类记忆,并保留其时间位置与原始证据。推理时,三个顺序执行的代理分别识别任务信息需求、规划多查询检索、联合推断出时空与上下文一致的用户状态,用于下游响应生成。QUMem在PersonaMem和KnowU-Bench两个基准上均达到当前最佳性能,验证了查询条件化用户状态推理在长期个性化中的有效性。

原文摘要 · Abstract (English)

Large language model (LLM) agents increasingly use external memory systems to support personalization by drawing on long and evolving interaction histories, in which user preferences may be distributed across time, change with context, and conflict with earlier evidence. However, existing systems face three limitations: fixed-turn, fixed-token, or session-based boundaries can mix unrelated dialogue or split an event from its causes, decisions, and outcomes; storing multiple pieces of user information from the same interaction as a single memory binds together items that serve different functions and should be independently retrievable; and treating the current task as a single top-$k$ retrieval query can return fragments that are individually relevant but fail to jointly capture preference evolution, temporal validity, and contextual applicability. We introduce \textsc{QUMem}, a structured memory framework for query-conditioned user-state inference. \textsc{QUMem} first segments interaction histories into variable-length episodes according to semantic continuity, then decomposes each episode into independently retrievable factual, preference, and transferable insight memories while preserving temporal positions and source evidence. At inference time, three sequential agents identify task-specific information needs, plan multi-query retrieval over the typed memory stores, and jointly infer a temporally and contextually valid user state for downstream response generation. \textsc{QUMem} achieves state-of-the-art performance on both PersonaMem and KnowU-Bench, demonstrating the effectiveness of query-conditioned user-state inference for long-term personalization.

大模型记忆机制个性化用户状态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。