单目视觉无人机竞速系统突破极限,击败人类冠军并实现百公里时速。
MonoRace: Winning Champion-Level Drone Racing with Robust Monocular AI
- 仅用单目摄像头与惯性传感器,结合神经网络与飞行模型实现鲁棒状态估计。
- 在2025阿布扎比竞赛中以100公里/小时速度完赛,超越所有参赛AI与三名人类世界冠军。
- 无需外部定位系统,通过飞行数据优化相机参数,适合轻量化自主飞行场景。
自主无人机竞速是机器人研究的重要前沿,要求人工智能在资源和时间受限的轻量级飞行器上运行,并将物理系统推至极限。现有技术依赖双目摄像头与惯性测量单元(IMU),在受控室内环境中击败了人类无人机竞速冠军。本文提出MonoRace:一种基于单目滚动快门摄像头与IMU的机载无人机竞速方法,可泛化至无外部运动追踪系统的竞赛环境。该方法融合神经网络门框分割与飞行器模型进行鲁棒状态估计,并引入基于已知门框几何结构的离线优化流程,仅使用机载飞行数据精调关键外部相机标定参数。引导与控制由直接输出电机指令的神经网络完成,小型网络以500Hz频率在飞控上运行。该方法赢得2025年阿布扎比自主无人机竞速大赛(A2RL),在直接淘汰赛中胜过所有参赛AI团队及三名人类世界冠军,创下新里程碑:在赛道上达到最高100公里/小时速度,有效应对相机干扰与IMU饱和等问题。
原文摘要 · Abstract (English)
Autonomous drone racing represents a major frontier in robotics research. It requires an Artificial Intelligence (AI) that can run on board light-weight flying robots under tight resource and time constraints, while pushing the physical system to its limits. The state of the art in this area consists of a system with a stereo camera and an inertial measurement unit (IMU) that beat human drone racing champions in a controlled indoor environment. Here, we present MonoRace: an onboard drone racing approach that uses a monocular, rolling-shutter camera and IMU that generalizes to a competition environment without any external motion tracking system. The approach features robust state estimation that combines neural-network-based gate segmentation with a drone model. Moreover, it includes an offline optimization procedure that leverages the known geometry of gates to refine any state estimation parameter. This offline optimization is based purely on onboard flight data and is important for fine-tuning the vital external camera calibration parameters. Furthermore, the guidance and control are performed by a neural network that foregoes inner loop controllers by directly sending motor commands. This small network runs on the flight controller at 500Hz. The proposed approach won the 2025 Abu Dhabi Autonomous Drone Racing Competition (A2RL), outperforming all competing AI teams and three human world champion pilots in a direct knockout tournament. It set a new milestone in autonomous drone racing research, reaching speeds up to 100 km/h on the competition track and successfully coping with problems such as camera interference and IMU saturation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。