提出Aux-Think框架,用思维链训练模型内化推理,提升视觉语言导航效率。
Aux-Think: Exploring Reasoning Strategies for Data-Efficient Vision-Language Navigation
- 通过预思考、后思考等策略系统评估推理对导航的影响
- 发现推理在推理时会降低准确率,存在推理崩溃现象
- 基于思维链标注数据集,实现高效训练与最优性能
视觉语言导航(VLN)是让具身智能体根据自然语言指令在复杂环境中导航的关键任务。尽管大模型显著提升了泛化能力和指令理解,但动作导向的长程导航中推理策略的作用仍不明确。我们首次系统评估了无思考、预思考和后思考三种推理策略,意外发现推理时会出现精度下降的“推理崩溃”问题。基于此,提出Aux-Think框架:在训练中通过思维链监督让模型内化结构化推理模式,推理时直接预测动作而无需额外思考。为此,我们发布了首个VLN思维链标注数据集R2R-CoT-320k。大量实验表明,该方法大幅减少训练成本,并在相同数据规模下取得最佳性能。
原文摘要 · Abstract (English)
Vision-Language Navigation (VLN) is a critical task for developing embodied agents that can follow natural language instructions to navigate in complex real-world environments. Recent advances in VLN by large pretrained models have significantly improved generalization and instruction grounding compared to traditional approaches. However, the role of reasoning strategies in navigation-an action-centric, long-horizon task-remains underexplored, despite Chain-of-Thought (CoT) reasoning's demonstrated success in static tasks like visual question answering. To address this gap, we conduct the first systematic evaluation of reasoning strategies for VLN, including No-Think (direct action prediction), Pre-Think (reason before action), and Post-Think (reason after action). Surprisingly, our findings reveal the Inference-time Reasoning Collapse issue, where inference-time reasoning degrades navigation accuracy, highlighting the challenges of integrating reasoning into VLN. Based on this insight, we propose Aux-Think, a framework that trains models to internalize structured reasoning patterns through CoT supervision, while inferring action directly without reasoning in online prediction. To support this framework, we release R2R-CoT-320k, the first Chain-of-Thought annotated dataset for VLN. Extensive experiments show that Aux-Think reduces training effort greatly and achieves the best performance under the same data scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。