arXiv:2605.15759cs.CL2026-05被引 1

用结构化维度信息提升大模型长时记忆效率与精度。

DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory

论文配图:DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory
图 1 · 摘自论文原文
  • 将记忆拆分为带时间、地点等字段的原子单元,支持精准检索与更新。
  • 在两个基准上分别达到81.43%和78.20%准确率,查询成本降低24%。
  • 小模型可高效学习结构化提取,性能媲美甚至超过大型模型。

大型语言模型(LLM)代理需要长期记忆来利用过往交互信息。然而,现有记忆系统常面临保真度与效率的权衡:原始对话历史开销大,而扁平的事实或摘要可能丢失精确召回所需的结构。本文提出轻量级的维度记忆框架 DimMem,将每条记忆表示为含时间、位置、原因、目的、关键词等显式字段的原子、类型化、自包含单元。该结构支持维度感知的检索、更新及选择性上下文召回,无需在模型上下文中存储完整历史。在 LoCoMo-10 与 LongMemEval-S 基准上,DimMem 分别实现 81.43% 和 78.20% 的整体准确率,优于现有轻量级记忆系统,且每查询令牌成本降低 24%。进一步表明,维度记忆提取可由小型模型学习:在 DimMem 模式微调后,Qwen3-4B 提取器在两个基准上超越 LightMem 与 GPT-4.1-mini,关键场景下性能接近或超过更大模型。结果表明,显式的维度结构是构建高效长时记忆的有效基础。代码已开源。

原文摘要 · Abstract (English)

Large language model (LLM) agents require long-term memory to leverage information from past interactions. However, existing memory systems often face a fidelity--efficiency trade-off: raw dialogue histories are expensive, while flat facts or summaries may discard the structure needed for precise recall. We propose \textbf{DimMem}, a lightweight dimensional memory framework that represents each memory as an atomic, typed, and self-contained unit with explicit fields such as time, location, reason, purpose, and keywords. This representation exposes the structure needed for dimension-aware retrieval, memory update, and selective assistant-context recall without storing full histories in the model context. Across LoCoMo-10 and LongMemEval-S, DimMem achieves \textbf{81.43\%} and \textbf{78.20\%} overall accuracy, respectively, outperforming existing lightweight memory systems while reducing LoCoMo per-query token cost by \textbf{24\%}. We further show that dimensional memory extraction is learnable by compact models: after fine-tuning on the DimMem schema, a Qwen3-4B extractor surpasses LightMem with GPT-4.1-mini on both benchmarks and reaches performance comparable to, or better than, much larger extractors in key settings. These results suggest that explicit dimensional structuring is an effective and efficient foundation for long-term memory in LLM agents. Code is available at https://github.com/ChowRunFa/DimMem.

长时记忆结构化记忆LLM代理轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。