让机器人持续学习新物品导航,还能不忘旧知识。
C-NAV: Towards Self-Evolving Continual Object Navigation in Open World
- 双路径防遗忘机制:对齐多模态特征并保留动作决策时序信息。
- 自适应采样减少冗余,内存开销显著降低。
- 适合研究持续学习、开放世界导航的学者和工程师。
具身智能体需在动态开放环境中完成物体导航任务。现有方法通常依赖静态轨迹和固定物品种类训练,忽视了现实世界中持续适应新场景的需求。为此,我们提出了持续物体导航基准,要求智能体在学习新类别物体导航技能的同时,避免对已有知识的灾难性遗忘。针对该挑战,我们提出C-Nav框架,包含两项关键创新:(1) 双路径防遗忘机制,包括特征蒸馏(对齐多模态输入至一致表征空间以保证表征一致性)和特征回放(在动作解码器中保留时序特征以保证策略一致性);(2) 自适应采样策略,选择多样且高信息量的经验,减少冗余并最小化内存开销。在多种模型架构上的大量实验表明,C-Nav持续优于现有方法,性能甚至超越全轨迹保留基线,同时显著降低内存需求。
原文摘要 · Abstract (English)
Embodied agents are expected to perform object navigation in dynamic, open-world environments. However, existing approaches typically rely on static trajectories and a fixed set of object categories during training, overlooking the real-world requirement for continual adaptation to evolving scenarios. To facilitate related studies, we introduce the continual object navigation benchmark, which requires agents to acquire navigation skills for new object categories while avoiding catastrophic forgetting of previously learned knowledge. To tackle this challenge, we propose C-Nav, a continual visual navigation framework that integrates two key innovations: (1) A dual-path anti-forgetting mechanism, which comprises feature distillation that aligns multi-modal inputs into a consistent representation space to ensure representation consistency, and feature replay that retains temporal features within the action decoder to ensure policy consistency. (2) An adaptive sampling strategy that selects diverse and informative experiences, thereby reducing redundancy and minimizing memory overhead. Extensive experiments across multiple model architectures demonstrate that C-Nav consistently outperforms existing approaches, achieving superior performance even compared to baselines with full trajectory retention, while significantly lowering memory requirements. The code will be publicly available at https://bigtree765.github.io/C-Nav-project.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。