arXiv:2606.03374cs.RO2026-06被引 1

为具身智能体设计了融合时空语义的混合记忆系统,支持长期稳定记忆。

eMEM: A Hybrid Spatio-Temporal Memory System For Embodied Agents

  • 用图结构统一存储语义、空间与时间信息,支持多维度检索
  • 在1小时到1年延迟下对房间唯一物品保持80.8分的稳定记忆表现
  • 专设认知心理学基准,可诊断记忆机制有效性,适合研究者使用

我们提出eMEM(具身记忆),一种面向物理环境中具身智能体的混合图结构记忆系统。现有记忆架构如Generative Agents、MemGPT和A-MEM将记忆视为文本流或知识图谱,但具身智能体需要同时支持语义、空间和时间维度的可搜索记忆。eMEM通过多索引架构(SQLITE用于结构化存储,hnswlib用于近似最近邻语义搜索,R-tree用于空间查询)统一在一个图模型后端实现。层级化整合流水线将原始感知输入转化为压缩摘要,类比生物系统的海马-皮层记忆巩固过程。提供十种面向智能体的记忆召回工具,包括概念到位置映射与跨层召回,作为大模型工具调用的一等操作。系统完全嵌入且与智能体同进程运行。我们还构建了eMEM-Bench v1,基于ProcTHOR-10K场景,涵盖八种认知心理学范式(DRM诱饵、模式分离、模式补全、来源监控、情境依赖回忆、长时程干扰、序列位置效应、含干扰项的保留曲线),结果可对照人类与先前系统记忆研究进行解释;这一诊断能力是表面任务基准如LoCoMo或OpenEQA无法提供的。eMEM在988个探测中取得80.8加权平均分,对房间唯一物品从1小时到1年延迟均保持天花板级留存曲线。纯RAG基线(flat_rag消融)在情境依赖回忆上损失30分,在DRM诱饵排斥上损失29分,分别凸显了多层存储与巩固机制的贡献。系统与基准代码均已开源。

原文摘要 · Abstract (English)

We present eMEM (Embodied Memory), a hybrid graph-based memory system for embodied agents operating in physical environments. Current agent memory architectures, such as Generative Agents, MemGPT, and A-MEM, treat memory as text streams or knowledge graphs, but embodied agents require memory that is simultaneously searchable by meaning, space, and time. eMEM fills this gap with a multi-index architecture (SQLITE for structured storage, hnswlib for approximate nearest neighbour semantic search, and an R-tree for spatial queries) unified behind a single graph model. A tiered consolidation pipeline transforms raw perceptual observations into compressed summaries, mirroring hippocampal-neocortical consolidation in biological systems. Ten agent-facing recall tools expose memory retrieval primitives, including concept-to-location resolution and cross layer recall, as first-class operations for LLM tool calling. The system is fully embedded and runs in-process alongside the agent. In addition we introduce eMEM-Bench v1, a benchmark we construct over ProcTHOR-10K scenes for embodied memory evaluation. The benchmark is organised explicitly around eight cognitive-psychology paradigms (DRM lures, pattern separation, pattern completion, source monitoring, context-dependent retrieval, long-horizon interference, serial position, and a foil augmented retention curve), each chosen so that the result is interpretable against the broader memory-systems literature in humans and prior agent-memory systems; a level of diagnostic that surface-task benchmarks like LoCoMo or OpenEQA cannot provide. eMEM scores 80.8 weighted mean over 988 probes, with a flat retention curve at ceiling from 1 h to 1 yr of simulated delay on room-unique items. We show that a pure RAG baseline (the flat_rag ablation) loses 30 pt on context dependent retrieval and 29 pt on DRM lure rejection, isolating the contribution of multi-layer storage and consolidation respectively. We release both the system and the benchmark code.

具身智能记忆系统多模态认知建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。