Mimir让智能体在复杂环境中长期执行任务时,能动态调用记忆并精准定位目标。
Mimir: A Neuro-Symbolic Memory System with Dynamic Grounding for Embodied Agents in Interactive Environments

- 分设世界记忆与任务记忆,动态绑定目标与环境事实
- 在EB-ALFRED上提升23%成功率,最长任务达86%成功
- 适合需要长期规划的具身智能体研究者使用
长周期具身任务要求智能体在部分可观测环境下行动,同时保持对场景信念和执行进度的感知。传统扁平化历史或隐式策略状态虽包含过往观察,但缺乏明确接口来判断哪些世界事实支持当前目标。我们提出Mimir,一种神经符号记忆系统,将世界记忆与任务记忆分离,并在每一步动作前动态接地。世界记忆存储物体位置、状态及感知证据,任务记忆则维护有序目标清单、进度、手部状态、失败记录与执行约束。接地模块将活跃目标与召回的世界候选匹配,补全缺失的位置信息并附上证据,再进行规划与具身执行。在多个主干模型下,Mimir在EB-ALFRED和EB-Habitat任务中分别取得最高42.5%和平均23.0%的提升。相比同主干下现有最先进方法,整体成功率平均提高8.5%。在EB-Habitat长周期子集上,达到86.0%的成功率,显著优于当前闭源模型。代码即将开源。
原文摘要 · Abstract (English)
Long-horizon embodied task requires agents to act under partial observability while preserving both scene belief and execution progress. Flat histories or implicit policy states may contain past observations, but they do not provide an explicit interface for deciding which world facts support the currently active goal. We introduce Mimir, a neuro-symbolic memory that separates world memory from task memory and dynamically grounds them before each action. World memory maintains object locations, object states, and perceptual evidence, while task memory maintains an ordered goal agenda, progress state, hand state, failures, and execution constraints. A grounding module binds the active goal to recalled world candidates, fills missing source locations, and attaches evidence before planning and embodiment-specific execution. Across tested backbones, Mimir consistently improves on different EB-ALFRED and EB-Habitat tasks, with maximum gains of 42.5% and average gains of 23.0%, respectively. Compared with the best results among prior agent and memory systems evaluated under the same backbone, Mimir improves the overall average success rate by 8.5%. Finally, on the EB-Habitat Long-horizon subset, Mimir achieves 86.0% success rate, substantially outperforming current closed-source models. Our code will be released soon.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。