让导航模型提前预判行动后果,提升找路效率
NavQ: Learning a Q-Model for Foresighted Vision-and-Language Navigation
- 用无标注轨迹训练Q模型,预估每步行动的未来信息
- 融合未来前景得分与历史信息,实现高效路径搜索
- 适合需要长距离规划的视觉语言导航任务
本文聚焦目标导向的视觉语言导航(VLN)任务。现有方法多依赖历史信息做决策,忽略行动的未来影响与长期结果。为此,我们提出一种前瞻性智能体,借鉴Q-learning,利用大规模未标注轨迹数据训练一个Q模型,学习室内场景布局与物体关系的通用知识。该模型为每个候选动作生成类似Q值的Q特征,描述采取该动作后可能获得的未来信息。随后,跨模态未来编码器将这些与任务无关的Q特征与导航指令结合,生成反映未来前景的动作评分。这些评分与基于历史的原始分数融合,支持类似A*的搜索策略,有效探索更可能通向目标的区域。在多个主流目标导向VLN数据集上的实验验证了方法的有效性。
原文摘要 · Abstract (English)
In this work we concentrate on the task of goal-oriented Vision-and-Language Navigation (VLN). Existing methods often make decisions based on historical information, overlooking the future implications and long-term outcomes of the actions. In contrast, we aim to develop a foresighted agent. Specifically, we draw upon Q-learning to train a Q-model using large-scale unlabeled trajectory data, in order to learn the general knowledge regarding the layout and object relations within indoor scenes. This model can generate a Q-feature, analogous to the Q-value in traditional Q-network, for each candidate action, which describes the potential future information that may be observed after taking the specific action. Subsequently, a cross-modal future encoder integrates the task-agnostic Q-feature with navigation instructions to produce a set of action scores reflecting future prospects. These scores, when combined with the original scores based on history, facilitate an A*-style searching strategy to effectively explore the regions that are more likely to lead to the destination. Extensive experiments conducted on widely used goal-oriented VLN datasets validate the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。