提出新框架,让无人机导航更准更稳,能看懂过去、规划未来、知道何时停下。
DreamFly: Causal Memory and Receding-Horizon Diffusion Planning for Aerial Vision-Language Navigation

- 用因果记忆融合历史视觉信息,避免未来信息泄露。
- 每步只执行一个动作,但规划未来多步动作,减少误差。
- 直接从动作概率判断是否到达终点,适合真实飞行场景。
空中视觉语言导航(Aerial VLN)要求智能体在部分可观测条件下,结合历史视觉证据、规划未来动作并判断是否抵达目标。尽管近期视觉语言代理(VLA)模型提供了感知到行动的范式,但将其应用于空中导航仍面临历史上下文有限、规划视野短和隐式终止不可靠等问题。为此,我们提出基于Dream-VLA的扩散模型框架DreamFly。DreamFly引入因果对齐的历史记忆,仅使用当前决策前的观测来增强当前视觉表示,实现时间推理且无未来信息泄露。进一步将导航建模为滚动时域扩散规划:策略预测K步动作块,但仅执行第一步后重新规划。该计划-K、执行-一策略利用未来动作作为辅助规划目标,同时保持闭环视觉反馈。最后,LiteStop直接从初始全掩码状态的动作逻辑值估计停止概率,将显式终止与动作生成解耦。在OpenFly基准测试中,DreamFly在已见和未见环境上分别取得32.04%/29.46%的到达率(SR)和28.22%/23.54%的路径长度归一化成功率(SPL),优于所有对比方法,并达到最低导航误差。结果表明,联合建模历史上下文、未来动作结构与显式终止对空中VLN有效。
原文摘要 · Abstract (English)
Aerial vision-language navigation (VLN) requires an embodied agent to integrate visual evidence over time, plan future actions, and determine when it has reached a navigation goal under partial observability. Although recent VLA models offer a promising perception-to-action paradigm, adapting them to aerial navigation remains challenging due to limited historical context, short planning horizons, and unreliable implicit termination. To address these challenges, we propose DreamFly, a diffusion-based aerial VLN framework built on Dream-VLA. DreamFly introduces a causally aligned historical memory that augments the current visual representation using only observations preceding the current decision step, enabling temporal reasoning without future information leakage. We further formulate navigation as receding-horizon diffusion planning, where the policy predicts a $K$-step action chunk but executes only the first action before replanning. This plan-$K$, execute-one strategy uses future actions as auxiliary planning targets while preserving closed-loop visual feedback. Finally, LiteStop estimates the stop probability directly from action logits at the initial all-mask state, decoupling explicit termination from action generation. Experiments on the OpenFly benchmark demonstrate consistent improvements in seen and unseen environments. DreamFly achieves 32.04%/29.46% SR and 28.22%/23.54% SPL on the test-seen/test-unseen splits, respectively, outperforming all compared methods on both metrics while attaining the lowest navigation error. These results demonstrate the effectiveness of jointly modeling historical context, future action structure, and explicit termination for aerial VLN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。