arXiv:2412.08467cs.CVcs.AI2024-12ICLR被引 23

通过自迭代优化数据流,让智能体导航能力超越人类。

Bootstrapping Language-Guided Navigation Learning with Self-Refining Data Flywheel

  • 用生成器与导航模型协作,自动打磨高质量导航数据
  • 导航成功率从70%提升至78%,首次超过人类(76%)
  • 适合大规模语言引导导航训练,尤其需少人工标注的场景

在具身人工智能中,构建高质量语言指令训练数据长期面临挑战。本文提出自精炼数据飞轮(SRDF),通过指令生成器与导航模型的协同迭代,无需人工标注即可生成大规模、高质的导航指令-轨迹对。初始阶段使用基础生成器创建数据池训练基础导航器,再由训练好的导航器筛选数据,提升数据质量以反向优化生成器,进而生成更优数据用于下一轮导航器训练。该循环机制形成数据自优化飞轮,持续产出高效数据集。实验表明,经多轮迭代后,导航器在经典R2R测试集上的SPL从70%提升至78%,首次超越人类表现(76%)。同时,生成器的SPICE指标从23.5提升至26.2,优于所有先前VLN指令生成方法。此外,该方法在环境与指令多样性扩展下展现良好可扩展性,预训练导航器在多个下游任务中均显著超越现有最佳方法。

原文摘要 · Abstract (English)

Creating high-quality data for training robust language-instructed agents is a long-lasting challenge in embodied AI. In this paper, we introduce a Self-Refining Data Flywheel (SRDF) that generates high-quality and large-scale navigational instruction-trajectory pairs by iteratively refining the data pool through the collaboration between two models, the instruction generator and the navigator, without any human-in-the-loop annotation. Specifically, SRDF starts with using a base generator to create an initial data pool for training a base navigator, followed by applying the trained navigator to filter the data pool. This leads to higher-fidelity data to train a better generator, which can, in turn, produce higher-quality data for training the next-round navigator. Such a flywheel establishes a data self-refining process, yielding a continuously improved and highly effective dataset for large-scale language-guided navigation learning. Our experiments demonstrate that after several flywheel rounds, the navigator elevates the performance boundary from 70% to 78% SPL on the classic R2R test set, surpassing human performance (76%) for the first time. Meanwhile, this process results in a superior generator, evidenced by a SPICE increase from 23.5 to 26.2, better than all previous VLN instruction generation methods. Finally, we demonstrate the scalability of our method through increasing environment and instruction diversity, and the generalization ability of our pre-trained navigator across various downstream navigation tasks, surpassing state-of-the-art methods by a large margin in all cases.

具身AI导航自迭代数据飞轮

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。