让大模型记忆按话题连续性组织,提升长对话理解能力
Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents
- 用话题编织器将对话分组为连贯话题盒,保持局部主题一致
- 跨话题追踪事件轨迹,恢复远距离会话中的重复目标与进展
- 在多轮对话中显著提升记忆检索准确率,适合长程任务场景
长期人机对话依赖话题连续性:相邻对话常围绕同一目标、计划、问题或事件展开,相关活动可能在遥远会话中重复出现。现有大模型代理记忆系统通常先将历史拆分为孤立回合或固定长度片段,再通过丰富、整合或检索机制补救,但这些方法仍受限于语义相近性或片段级记录,削弱了时间与因果结构,使记忆访问偏向语义相似而非任务或话题连续性。本文提出 extbf{Membox},一种层级化记忆架构,将话题连续性作为显式组织层。其 extbf{话题织布机} 逐步将对话流组织成内部回合共享同一局部话题的盒子; extbf{痕迹编织者} 将跨盒子提取的事件连接成宏观话题轨迹,恢复远距离会话中反复出现的目标、活动与事实进展。在 LoCoMo 数据集上,仅使用话题织布机的检索比最优 Mem0/A-MEM 检索深度设置提升 13.00 F1 分(53.95 vs. 40.95),加入轨迹扩展后进一步提升至 55.28;使用 GPT-4o 时达 59.71 F1。DialSim 实验也显示,跨盒子轨迹在多方对话中带来相同性能增益。结果表明,局部话题连续性组织与宏观话题轨迹扩展能显著超越基于碎片化记录的语义检索。
原文摘要 · Abstract (English)
Long-term human-agent dialogues are organized by topic continuity: adjacent turns often develop the same goal, plan, problem, or event, while related activities may recur across distant sessions. Yet many LLM agent memory systems first decompose histories into isolated turns or fixed-size chunks, then compensate through enrichment, consolidation, or retrieval mechanisms still tied to semantic proximity or fragment-level records. This weakens temporal and causal organization and biases memory access toward semantic proximity rather than task- or topic-level continuity. We introduce \emph{Membox}, a hierarchical memory architecture that instantiates topic continuity as an explicit organization layer for agent memory. Its \textbf{Topic Loom} incrementally organizes dialogue streams into boxes whose internal turns follow the same local topic, while its \textbf{Trace Weaver} links extracted events across boxes into macro-topic traces that recover recurring activities, goals, and factual developments across distant sessions. On LoCoMo, Topic-Loom-only retrieval improves over the best Mem0/A-MEM retrieval-depth setting by 13.00 F1 points (53.95 vs. 40.95), and trace-expanded retrieval further raises F1 to 55.28; with GPT-4o, trace-expanded retrieval reaches 59.71 F1. Additional DialSim results show the same gain from adding cross-box traces in multi-party dialogue. These results show that local topic-continuity organization and macro-topic trace expansion improve long-range memory beyond semantic retrieval over fragmented records.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。