Mandol统一记忆存储与检索,提升长对话系统记忆效率与准确性。
Mandol: An Agglomerative Agent Memory System for Long-Term Conversations

- 构建分层记忆结构,将原始信息与抽象记忆统一为语义图
- 实现跨库无延迟检索,10 QPS下检索速度提升5.4倍
- 无需大模型参与即可完成精准查询,适合高并发场景
长时对话智能体需记住并查询跨会话、多类型且具有复杂关联的信息。现有记忆系统依赖异构的向量与图数据库,导致信息碎片化并引发高跨库I/O延迟。常见RAG方法在检索中易引入噪声、遗漏相关线索,且缺乏令牌预算控制,影响LLM的准确性和效率。本文提出Mandol,一种聚合式记忆系统,将分散的记忆表示与存储整合为统一的内存原生架构。其核心包括:(1) 分层记忆模型,将记忆分为原始信息层与高层抽象层,均以结构化语义图统一表示;(2) 聚合语义数据结构,融合键值、向量与图结构,提供统一混合检索算子,消除跨库I/O;(3) 基于量化查询机制,支持查询自适应路由、定量去噪与冲突消解,并在检索中不调用大模型。在两个主流长时对话基准LoCoMo与LongMemEval上的实验表明,Mandol在代表性记忆系统中达到最优综合准确率。在10 QPS并发负载下,相比基线,检索速度提升5.4倍,插入速度提升4.8倍,且在消费级硬件上保持低延迟。
原文摘要 · Abstract (English)
Long-term conversational agents need to remember and query cross-session, multi-typed information with complex correlations. Existing agent memory systems rely on heterogeneous vector and graph databases, which fragment memory information and cause high cross-database I/O latency. For retrieval, common RAG-style methods tend to introduce noise, miss correlated clues, and lack token budget control, degrading LLM accuracy and efficiency. We propose Mandol, an agglomerative memory system that consolidates fragmented memory representations and storage into a unified memory-native architecture. Its core components include: (1) a hierarchical memory model that organizes memory into a basic layer representing raw memory information and a high-level abstract layer that agglomerates basic memories into traceable abstract memories, both uniformly represented as structured semantic graphs; (2) an agglomerative semantic data structure combining SemanticMap and SemanticGraph, which natively fuses key-value, vector, and graph structures and provides unified hybrid retrieval operators to eliminate cross-database I/O; and (3) a quantitative query mechanism with query-adaptive routing, quantitative denoising and conflict resolution, and token-constrained context generation, all without involving LLMs during retrieval. Experiments on two widely used long-term conversation benchmarks, LoCoMo and LongMemEval, show that Mandol achieves the best overall accuracy among representative agent memory systems. For performance comparison, Mandol also obtains a 5.4x retrieval speedup and a 4.8x insertion speedup under 10 QPS concurrent load, while still maintaining low latency on consumer-grade hardware.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。