让无人机看懂目标后,分步思考再行动,更准停靠。
Deliberate Before You Fly: Vision-Guided Spatial Deliberation for UAV See-and-Reach Navigation

- 先分步决策方向、诊断空间、定动作,再生成路径
- 成功率达94.1%,比顶尖方法高25.07个百分点
- 适合需要精准停靠的无人机导航任务
无人机视觉-语言寻物导航要求飞行体在初始视野中识别语言指定的目标并可靠停靠附近。现有方法直接将视觉-语言表征映射为动作输出,未显式建模中间细粒度空间决策,导致语义控制错位,动作不一致且终止不可靠。为此,本文提出DBFly框架,在生成航点前引入显式的视觉引导空间思辨机制。具体而言,DBFly构建空间动作决策链,逐步完成目标方向锚定、空间诊断与动作决策,使高层动作意图显式指导连续航点生成。同时,通过将初始目标方向先验转换为持久几何参考,并基于当前位置动态推导飞行走廊状态,提供软性几何引导以支持空间诊断与动作修正。此外,设计终端收敛感知停止策略,通过目标接近度与短时运动收敛性共同刻画终止状态,实现更可靠的停靠。在可见、不可见物体及场景测试集上广泛实验表明,DBFly相较最先进基线平均提升成功率25.07个百分点。
原文摘要 · Abstract (English)
UAV see-and-reach navigation requires an aerial agent to approach a language-specified target visible in its initial view and stop reliably near it. Existing methods typically map vision-language representations directly to action outputs without explicitly modeling intermediate fine-grained spatial decisions. This direct mapping causes semantic-control misalignment, leading to inconsistent maneuvers and unreliable termination. To address this issue, we propose DBFly, a vision-language waypoint prediction framework that introduces explicit vision-guided spatial deliberation before waypoint generation. Specifically, DBFly introduces a spatial maneuver decision chain that progressively performs target-direction anchoring, spatial diagnosis, and maneuver decision, enabling high-level maneuver intent to explicitly guide continuous waypoint generation. DBFly further constructs an implicit flight corridor by transforming the initial target-direction prior into a persistent geometric reference and deriving an online corridor state from the UAV's current position, thereby providing soft geometric guidance for spatial diagnosis and maneuver correction. In addition, DBFly develops a terminal-convergence-aware stopping strategy that characterizes terminal states through both target proximity and short-horizon motion convergence, enabling more reliable stopping near the target. Extensive experiments across seen, unseen-object, and unseen-scene test sets demonstrate that DBFly improves the success rate over the SOTA baseline by an average of 25.07 percentage points. The project homepage is available at https://xuefanfu.github.io/DBFly-Page.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。