用用户反馈提升视觉语言导航的适应能力,让机器人更听懂人话。
User-Feedback-Driven Adaptation for Vision-and-Language Navigation
- 以用户成功确认和目标修正作为主要监督信号,比内部置信度更准确。
- 通过拓扑图生成路径,将稀疏反馈转化为密集指导,实现高效模仿学习。
- 支持跨会话记忆复用,适合需要长期适应的真实场景应用。
现实世界中视觉语言导航(VLN)智能体的部署受限于离线训练后缺乏可靠监督。现有自监督方法依赖环境信号(如熵最小化),但噪声大,易放大错误。本文提出新范式:将用户反馈(任务级成功确认与目标级修正)作为核心监督信号,其意图对齐且实时一致,可直接纠正智能体与指令的脱节。为此设计用户反馈驱动的学习框架,包含拓扑感知轨迹构建机制,通过增量构建的拓扑图生成可行路径,将稀疏的目标级修正转化为稠密路径级监督,实现无需逐步人工标注的样本高效模仿学习。同时引入持久化记忆库,支持跨会话复用已获拓扑结构与缓存表示。在GSA-R2R基准上的实验表明,该方法将稀疏交互转化为鲁棒监督,持续优于环境驱动基线,且对不同指令风格具备强适应性。
原文摘要 · Abstract (English)
Real-world deployment of Vision-and-Language Navigation (VLN) agents is constrained by the scarcity of reliable supervision after offline training. While recent adaptation methods attempt to mitigate distribution shifts via environment-driven self-supervision (e.g., entropy minimization), these signals are often noisy and can cause the agent to amplify its own mistakes during long-horizon sequential decision-making. In this paper, we propose a paradigm shift that positions user feedback, specifically episode-level success confirmations and goal-level corrections, as a primary and general-purpose supervision signal for VLN. Unlike internal confidence scores, user feedback is intent-aligned and in-situ consistent, directly correcting the agent's decoupling from user instructions. To effectively leverage this supervision, we introduce a user-feedback-driven learning framework featuring a topology-aware trajectory construction pipeline. This mechanism lifts sparse, goal-level corrections into dense path-level supervision by generating feasible paths on the agent's incrementally built topological graph, enabling sample-efficient imitation learning without requiring step-by-step human demonstrations. Furthermore, we develop a persistent memory bank mechanism for warm-start initialization, supporting the reuse of previously acquired topology and cached representations across navigation sessions. Extensive experiments on the GSA-R2R benchmark demonstrate that our approach transforms sparse interaction into robust supervision, consistently outperforming environment-driven baselines while exhibiting strong adaptability across diverse instruction styles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。