对话驱动动态协作,让多机器人导航更智能高效。
DeCoNav: Dialog enhanced Long-Horizon Collaborative Vision-Language Navigation
- 通过事件触发对话实现去中心化实时协调
- 在176个场景中任务成功率提升69.2%
- 适合需要动态协同的多机器人系统研究
长时程协同视觉语言导航对多机器人系统完成单机无法胜任的复杂任务至关重要。CoNavBench首次提出包含接力式多机器人任务、协作分类体系及基于图的生成与评估方法的基准,用于建模共享环境中的交接与会合。然而现有基准与评估通常未强制双机器人在共享世界时间线上严格同步执行,且依赖静态协调策略,无法适应新跨代理证据出现的情况。本文提出去中心化框架DeCoNav,将事件触发对话与动态任务分配及重规划结合,实现实时自适应协调。机器人通过对话交换紧凑语义状态,不依赖中央控制器。当出现新证据、不确定性或冲突等关键事件时,触发对话以动态重新分配子目标并重规划,确保同步执行。在包含1,213个任务的176个HM3D场景中实现部署,双成功率达69.2%的显著提升,验证了对话驱动动态重规划在多机器人协作中的有效性。
原文摘要 · Abstract (English)
Long-horizon collaborative vision-language navigation (VLN) is critical for multi-robot systems to accomplish complex tasks beyond the capability of a single agent. CoNavBench takes a first step by introducing the first collaborative long-horizon VLN benchmark with relay-style multi-robot tasks, a collaboration taxonomy, along with graph-grounded generation and evaluation to model handoffs and rendezvous in shared environments. However, existing benchmarks and evaluations often do not enforce strictly synchronized dual-robot rollout on a shared world timeline, and they typically rely on static coordination policies that cannot adapt when new cross-agent evidence emerges. We present Dialog enhanced Long-Horizon Collaborative Vision-Language Navigation (DeCoNav), a decentralized framework that couples event-triggered dialogue with dynamic task allocation and replanning for real-time, adaptive coordination. In DeCoNav, robots exchange compact semantic states via dialogue without a central controller. When informative events such as new evidence, uncertainty, or conflicts arise, dialogue is triggered to dynamically reassign subgoals and replan under synchronized execution. Implemented in DeCoNavBench with 1,213 tasks across 176 HM3D scenes, DeCoNav improves the both-success rate (BSR) by 69.2%, demonstrating the effectiveness of dialogue-driven, dynamically reallocated planning for multi-robot collaboration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。