让机器人通过短暂对话学习新环境寻物,无需数据共享。
CON: Continual Object Navigation via Data-Free Inter-Agent Knowledge Transfer in Unseen and Unfamiliar Places
- 用查询式占用图表示目标位置,实现无数据交互的知识传递。
- 在未见过的环境中,寻物成功率提升37%,优于零样本方法。
- 适用于开放世界中非协作机器人的轻量级知识迁移,适合部署于真实场景。
本文探索了简短的跨机器人知识迁移(KT)在未知、不熟悉环境中的持续物体导航(ON)潜力。受人类旅行者获取本地知识的启发,提出一种框架:旅行机器人(学生)与本地机器人(教师)通过最少交互获得ON知识。将此过程视为无数据持续学习(CL)挑战,旨在从黑盒模型(教师)向新模型(学生)转移知识。相比使用大语言模型(LLMs)进行零样本导航的自然语言表达,基于对象特征图的前沿驱动方法和基于神经状态-动作映射的学习型方法面临更复杂的知识迁移难题,且无数据KT尚未被充分探索。为此,提出一个轻量级、即插即用的KT模块,适用于开放世界中非协作的黑盒教师。基于所有教师具备视觉与移动能力的通用假设,定义状态-动作历史为知识基础。由此构建查询式占用图,动态表征目标物体位置,作为高效且通信友好的知识表示。在Habitat环境中验证了方法的有效性。
原文摘要 · Abstract (English)
This work explores the potential of brief inter-agent knowledge transfer (KT) to enhance the robotic object goal navigation (ON) in unseen and unfamiliar environments. Drawing on the analogy of human travelers acquiring local knowledge, we propose a framework in which a traveler robot (student) communicates with local robots (teachers) to obtain ON knowledge through minimal interactions. We frame this process as a data-free continual learning (CL) challenge, aiming to transfer knowledge from a black-box model (teacher) to a new model (student). In contrast to approaches like zero-shot ON using large language models (LLMs), which utilize inherently communication-friendly natural language for knowledge representation, the other two major ON approaches -- frontier-driven methods using object feature maps and learning-based ON using neural state-action maps -- present complex challenges where data-free KT remains largely uncharted. To address this gap, we propose a lightweight, plug-and-play KT module targeting non-cooperative black-box teachers in open-world settings. Using the universal assumption that every teacher robot has vision and mobility capabilities, we define state-action history as the primary knowledge base. Our formulation leads to the development of a query-based occupancy map that dynamically represents target object locations, serving as an effective and communication-friendly knowledge representation. We validate the effectiveness of our method through experiments conducted in the Habitat environment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。