LongFly提升无人机长距离导航能力,通过时空融合实现精准路径规划。
LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integration
- 用槽式压缩模块将历史图像转为紧凑上下文表示
- 在真实与未知环境中成功率达92.1%,路径加权成功率提升6.33%
- 适合灾害救援、长航时无人机导航场景
无人机在灾后搜救中至关重要,但面临信息密集、视角快速变化和动态结构等挑战,尤其在长距离导航中。现有视觉语言导航方法难以建模复杂环境下的长时序时空上下文,导致语义对齐不准和路径规划不稳定。为此,我们提出LongFly,一种面向长距离无人机视觉语言导航的时空上下文建模框架。LongFly采用历史感知的时空建模策略,将碎片化冗余的历史数据转化为结构化、紧凑且富有表现力的表征。首先,设计基于槽的歷史图像压缩模块,动态提炼多视角历史观测为固定长度上下文表示;其次,引入时空轨迹编码模块,捕捉无人机轨迹的时间动态与空间结构;最后,构建提示引导的多模态融合模块,支持基于时间的推理与鲁棒的航点预测。实验表明,LongFly在已见与未见环境中均优于当前最优基线,成功率达92.1%,路径加权成功率提升6.33%。
原文摘要 · Abstract (English)
Unmanned aerial vehicles (UAVs) are crucial tools for post-disaster search and rescue, facing challenges such as high information density, rapid changes in viewpoint, and dynamic structures, especially in long-horizon navigation. However, current UAV vision-and-language navigation(VLN) methods struggle to model long-horizon spatiotemporal context in complex environments, resulting in inaccurate semantic alignment and unstable path planning. To this end, we propose LongFly, a spatiotemporal context modeling framework for long-horizon UAV VLN. LongFly proposes a history-aware spatiotemporal modeling strategy that transforms fragmented and redundant historical data into structured, compact, and expressive representations. First, we propose the slot-based historical image compression module, which dynamically distills multi-view historical observations into fixed-length contextual representations. Then, the spatiotemporal trajectory encoding module is introduced to capture the temporal dynamics and spatial structure of UAV trajectories. Finally, to integrate existing spatiotemporal context with current observations, we design the prompt-guided multimodal integration module to support time-based reasoning and robust waypoint prediction. Experimental results demonstrate that LongFly outperforms state-of-the-art UAV VLN baselines by 7.89\% in success rate and 6.33\% in success weighted by path length, consistently across both seen and unseen environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。