arXiv:2507.11302cs.ROcs.CV2025-07

仅用视觉实现无人机姿态控制,无需惯性传感器。

All Eyes, no IMU: Learning Flight Attitude from Vision Alone

  • 用事件相机和递归卷积网络从光流中估计姿态与角速度。
  • 实测可替代惯性测量单元,实现无惯性传感器飞行。
  • 窄视场网络泛化能力更强,适合复杂环境应用。

视觉对许多飞行生物的姿态控制至关重要,有些甚至没有重力感知。而飞行机器人通常依赖加速度计和陀螺仪进行姿态稳定。本文首次提出适用于通用环境的纯视觉飞行控制方法。我们证明,配备向下视角事件相机的四旋翼无人机仅通过事件流即可估计其姿态和旋转速率,从而实现无惯性传感器的飞行控制。该方法采用小型递归卷积神经网络,通过监督学习训练。真实飞行测试表明,事件相机与低延迟神经网络的组合可替代传统飞行控制环中的惯性测量单元(IMU)。此外,我们研究了网络在不同环境下的泛化能力,以及记忆机制和视场范围的影响。具有记忆功能并能获取类似地平线视觉线索的网络性能最佳,但视场较窄的变体展现出更优的相对泛化能力。本工作展示了纯视觉飞行控制在实现自主、类昆虫尺度飞行机器人方面的巨大潜力。

原文摘要 · Abstract (English)

Vision is an essential part of attitude control for many flying animals, some of which have no dedicated sense of gravity. Flying robots, on the other hand, typically depend heavily on accelerometers and gyroscopes for attitude stabilization. In this work, we present the first vision-only approach to flight control for use in generic environments. We show that a quadrotor drone equipped with a downward-facing event camera can estimate its attitude and rotation rate from just the event stream, enabling flight control without inertial sensors. Our approach uses a small recurrent convolutional neural network trained through supervised learning. Real-world flight tests demonstrate that our combination of event camera and low-latency neural network is capable of replacing the inertial measurement unit in a traditional flight control loop. Furthermore, we investigate the network's generalization across different environments, and the impact of memory and different fields of view. While networks with memory and access to horizon-like visual cues achieve best performance, variants with a narrower field of view achieve better relative generalization. Our work showcases vision-only flight control as a promising candidate for enabling autonomous, insect-scale flying robots.

视觉控制事件相机无惯性飞行微型无人机

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。