arXiv:2605.18729cs.ROcs.CV2026-05

机器人通过自我反思与知识提炼,实现复杂环境下的自主导航进化。

Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Induction

论文配图:Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Induction
图 1 · 摘自论文原文
  • 构建双粒度记忆系统,分层抽象经验中的成功与失败模式。
  • 在未见过环境中提升导航成功率,最高达+15.30% SPL。
  • 适合研究具身智能、自进化机器人系统的学者与工程师。

真实世界中具身智能体的导航与交互能力至关重要,但面对未知环境时,传统基于轨迹或反应式策略常因“经验遗忘”而无法生成可泛化的决策方法。本文提出Robo-Cortex,一种支持机器人自我演化的框架,通过持续的反思-适应循环,自主归纳导航启发式规则并优化认知策略。其核心是自主知识归纳(AKI)机制,将多模态轨迹提炼为结构化导航启发式库以实现知识泛化。系统包含双粒度认知记忆:短期反思记忆(SRM)用于实时局部进展分析,长期原则记忆(LPM)则将过往轨迹抽象为可复用的指导与警示原则。为确保决策鲁棒性,引入多模态“想象-验证”循环,由世界模型模拟潜在结果,并通过视觉语言模型(VLM)评估行动方案。在IGNav、AR和AEQA数据集上的实验表明,Robo-Cortex在任务成功率与探索效率上均显著优于强基线,最高较最优前序方法提升+4.16% SPL;在启发式迁移至未见环境时,性能提升高达+15.30% SPL。初步的实体机器人实验也验证了其在真实场景中的有效性。

原文摘要 · Abstract (English)

The ability to navigate and interact with complex environments is central to real-world embodied agents, yet navigation in unseen environments remains challenging due to "experiential amnesia," where existing trajectory-driven or reactive policies fail to synthesize generalizable strategies from past interactions. We propose Robo-Cortex, a self-evolving framework that enables robots to autonomously induce navigation heuristics and refine cognitive strategies through a continuous reflection-adaptation loop. By abstracting success patterns and failure pitfalls into natural-language heuristics, Robo-Cortex enables a transition from passive execution to active strategy evolution. Our core innovation is an Autonomous Knowledge Induction (AKI) mechanism that distills multimodal trajectories into a structured Navigation Heuristic Library for knowledge generalization. The architecture further incorporates a Dual-Grain Cognitive Memory system, comprising a Short-term Reflective Memory (SRM) for real-time local progress analysis, and a Long-term Principle Memory (LPM) that abstracts past trajectories into reusable guiding and cautionary principles. To ensure robust decision-making, we introduce a multimodal Imagine-then-Verify loop, where a world model simulates potential outcomes and a VLM-based evaluator validates action plans. Extensive evaluations on IGNav, AR, and AEQA show that Robo-Cortex consistently outperforms strong baselines in both task success and exploration efficiency, with gains of up to +4.16% SPL over the strongest prior method and up to +15.30% SPL under heuristic transfer to unseen environments. Preliminary real-world robotic experiments further support the effectiveness of Robo-Cortex in physical settings.

具身智能自进化导航多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。