arXiv:2606.09088cs.RO2026-06

用视觉流与不确定性掩码实现高速自主穿越复杂环境的无人机飞行

Autonomous FPV Flight with Translational Optical Flow and Uncertainty Mask

论文配图:Autonomous FPV Flight with Translational Optical Flow and Uncertainty Mask
图 1 · 摘自论文原文
  • 分离平移与旋转光流,仅使用平移分量提取深度信息
  • 引入双向光流不一致性生成不确定性掩码,提升障碍物检测精度
  • 在模拟与真实森林环境中实现超11米/秒的飞行速度,成功率93.3%

仅依赖单目RGB相机作为外部感知传感器的自主FPV四旋翼飞行在复杂环境中仍面临根本性挑战。近期研究显示,将光流输入神经网络可实现杂乱场景下的端到端自主飞行,但如何从光流估计中提取最相关的信息仍是限制敏捷性与鲁棒性的关键瓶颈。现有方法难以区分障碍物引起的光流与自身运动背景流,且在视点扩张中心(FoE)附近信噪比低。为此,本文将光流分解为平移与旋转分量,仅使用平移流捕捉场景几何与深度信息。同时,引入基于前后向光流估计不一致性的不确定性掩码,突出显示障碍物结构,包括FoE区域内的物体。两个信号共同输入在可微仿真框架中训练的控制策略,实现感知与控制的高效一阶优化。通过在模拟与真实森林环境中的大量实验验证,该系统在模拟中达到最高13.91米/秒飞行速度,在真实测试中达11.79米/秒,30次真实试验成功率达93.3%,几乎将此前单目RGB光流无人机避障系统的实测速度6米/秒翻倍。

原文摘要 · Abstract (English)

Autonomous FPV quadrotor flight in complex environments using a monocular RGB camera as the sole exteroceptive sensor remains a fundamental challenge. Recent research has shown that using optical flow as the input of a neural network can achieve end-to-end autonomous flight in cluttered scenes. However, extracting the most relevant information from the flow estimation is the key bottleneck limiting agility and robustness. Existing methods struggle to disentangle obstacle-induced optical flow from the ego-motion background flow and suffer from low signal-to-noise ratios near the focus of expansion (FoE). To address these issues, we decompose the optical flow into translational and rotational components and utilize only the translational flow, which captures scene geometry and depth cues. In addition, we introduce an uncertainty mask derived from inconsistencies between forward and backward flow estimates. This mask highlights obstacle structures, including those within the FoE region. Both cues are fed to a control policy trained in a differentiable simulation framework, which enables efficient first-order optimization across perception and control. We validate our approach through extensive experiments in both simulated and real-world forest environments. The proposed system achieves robust flight at speeds of up to 13.91 m/s in simulation and 11.79 m/s in real-world tests, with a 93.3\% success rate over 30 real-world trials, nearly doubling the previously reported 6 m/s real-world speed of the monocular-RGB optical-flow UAV obstacle avoidance system.

自主飞行光流无人机强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。