arXiv:2505.11886cs.RO2025-05NeurIPS被引 22

提出Aux-Think框架,用思维链训练模型内化推理,提升视觉语言导航效率。

Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation

  • 通过预思考、后思考等策略系统评估推理对导航的影响
  • 发现推理在推理时会降低准确率,存在推理崩溃现象
  • 基于思维链标注数据集,实现高效训练与最优性能

视觉语言导航(VLN)是让具身智能体根据自然语言指令在复杂环境中导航的关键任务。尽管大模型显著提升了泛化能力和指令理解,但动作导向的长程导航中推理策略的作用仍不明确。我们首次系统评估了无思考、预思考和后思考三种推理策略,意外发现推理时会出现精度下降的“推理崩溃”问题。基于此,提出Aux-Think框架:在训练中通过思维链监督让模型内化结构化推理模式,推理时直接预测动作而无需额外思考。为此,我们发布了首个VLN思维链标注数据集R2R-CoT-320k。大量实验表明,该方法大幅减少训练成本,并在相同数据规模下取得最佳性能。

原文摘要 · Abstract (English)

Vision-Language Navigation (VLN) is a critical task for developing embodied agents that can follow natural language instructions to navigate in complex real-world environments. Recent advances in VLN by large pretrained models have significantly improved generalization and instruction grounding compared to traditional approaches. However, the role of reasoning strategies in navigation-an action-centric, long-horizon task-remains underexplored, despite Chain-of-Thought (CoT) reasoning's demonstrated success in static tasks like visual question answering. To address this gap, we conduct the first systematic evaluation of reasoning strategies for VLN, including No-Think (direct action prediction), Pre-Think (reason before action), and Post-Think (reason after action). Surprisingly, our findings reveal the Inference-time Reasoning Collapse issue, where inference-time reasoning degrades navigation accuracy, highlighting the challenges of integrating reasoning into VLN. Based on this insight, we propose Aux-Think, a framework that trains models to internalize structured reasoning patterns through CoT supervision, while inferring action directly without reasoning in online prediction. To support this framework, we release R2R-CoT-320k, the first Chain-of-Thought annotated dataset for VLN. Extensive experiments show that Aux-Think reduces training effort greatly and achieves the best performance under the same data scale.

视觉导航思维链具身智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。