arXiv:2604.16331cs.ROcs.AI2026-04被引 2

给机器人装上类脑记忆,让其学会从经验中持续改进任务规划。

BrainMem: Brain-Inspired Evolving Memory for Embodied Agent Task Planning

论文配图:BrainMem: Brain-Inspired Evolving Memory for Embodied Agent Task Planning
图 1 · 摘自论文原文
  • 模仿人类认知,构建工作、情景和语义三层记忆系统。
  • 无需训练,直接提升长程与复杂空间任务的成功率。
  • 适合需要长期学习和适应性的智能体研究者使用。

具身任务规划要求智能体在复杂的3D环境中执行长周期、目标导向的行为,成功依赖于即时感知与跨任务积累的经验。然而,现有基于大语言模型(LLM)的规划器多为无状态、反应式,缺乏持久记忆,导致重复错误且难以处理空间或时间依赖性问题。我们提出BrainMem(类脑演化记忆),一种无需训练的分层记忆系统,借鉴人类认知机制,为具身智能体赋予工作记忆、情景记忆和语义记忆。BrainMem将交互历史持续转化为结构化知识图谱与提炼后的符号化指导规则,使规划器能检索、推理并适应过往经验,无需模型微调或额外训练。该即插即用设计可无缝集成任意多模态大语言模型,大幅降低对特定任务提示工程的依赖。在四个代表性基准测试(EB-ALFRED、EB-Navigation、EB-Manipulation、EB-Habitat)上的大量实验表明,BrainMem显著提升了多种模型与难度子集的任务成功率,尤其在长周期和空间复杂任务上提升最明显。结果凸显了演化记忆作为通用具身智能可行且可扩展的机制。

原文摘要 · Abstract (English)

Embodied task planning requires agents to execute long-horizon, goal-directed actions in complex 3D environments, where success depends on both immediate perception and accumulated experience across tasks. However, most existing LLM-based planners are stateless and reactive, operating without persistent memory and therefore repeating errors and struggling with spatial or temporal dependencies. We propose BrainMem(Brain-Inspired Evolving Memory), a training-free hierarchical memory system that equips embodied agents with working, episodic, and semantic memory inspired by human cognition. BrainMem continuously transforms interaction histories into structured knowledge graphs and distilled symbolic guidelines, enabling planners to retrieve, reason over, and adapt behaviors from past experience without any model fine-tuning or additional training. This plug-and-play design integrates seamlessly with arbitrary multi-modal LLMs and greatly reduces reliance on task-specific prompt engineering. Extensive experiments on four representative benchmarks, including EB-ALFRED, EB-Navigation, EB-Manipulation, and EB-Habitat, demonstrate that BrainMem significantly enhances task success rates across diverse models and difficulty subsets, with the largest gains observed on long-horizon and spatially complex tasks. These results highlight evolving memory as a promising and scalable mechanism for generalizable embodied intelligence.

具身智能类脑记忆任务规划LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。