提出脑启发的多记忆框架,让机器人在真实环境中持续学习并长期适应。
RoboMemory: A Brain-inspired Multi-memory Agentic Framework for Interactive Environmental Learning in Physical Embodied Systems
- 融合空间、时间、事件和语义记忆,构建并行化多模态记忆系统。
- 在EmbodiedBench上提升26.5%成功率,优于Claude-3.5-Sonnet等闭源模型。
- 适合需要长期交互与累积学习的物理机器人系统研究者使用。
具身智能旨在使机器人在复杂真实环境中实现稳健的学习、推理与泛化。然而,现有方法常受限于部分可观测性、碎片化空间推理及异构记忆整合效率低,难以支持长时程适应。为此,我们提出RoboMemory,一种受大脑启发的框架,通过并行架构统一空间、时间、事件与语义记忆,实现高效的长时程规划与交互式学习。其核心创新包括:用于可扩展、一致记忆更新的动态空间知识图谱,以及带评估模块的闭环规划器以实现自适应决策。在EmbodiedBench上的大量实验表明,基于Qwen2.5-VL-72B-Ins实例化的RoboMemory,平均成功率较强基线提升26.5%,甚至超越闭源先进模型Claude-3.5-Sonnet。真实世界测试进一步验证其累积学习能力,性能随重复任务持续提升。结果表明,RoboMemory为记忆增强型具身智能体提供可扩展基础,融合认知神经科学洞见与实际机器人自主性。
原文摘要 · Abstract (English)
Embodied intelligence aims to enable robots to learn, reason, and generalize robustly across complex real-world environments. However, existing approaches often struggle with partial observability, fragmented spatial reasoning, and inefficient integration of heterogeneous memories, limiting their capacity for long-horizon adaptation. To address this, we introduce RoboMemory, a brain-inspired framework that unifies Spatial, Temporal, Episodic, and Semantic memory within a parallelized architecture for efficient long-horizon planning and interactive learning. Its core innovations are a dynamic spatial knowledge graph for scalable, consistent memory updates and a closed-loop planner with a critic module for adaptive decision-making. Extensive experiments on EmbodiedBench show that RoboMemory, instantiated with Qwen2.5-VL-72B-Ins, improves the average success rate by 26.5% over its strong baseline and even surpasses the closed-source SOTA, Claude-3.5-Sonnet. Real-world trials further confirm its capability for cumulative learning, with performance consistently improving over repeated tasks. Our results position RoboMemory as a scalable foundation for memory-augmented embodied agents, bridging insights from cognitive neuroscience with practical robotic autonomy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。