arXiv:2512.09571cs.RO2025-12中稿 · ICRA被引 5

让无人机在陌生杂乱环境中高速飞行不撞门,靠两阶段训练+视觉强化。

Mastering Diverse, Unknown, and Cluttered Tracks for Robust Vision-Based Drone Racing

  • 分两阶段训练:先允许轻碰撞保探索,再严控硬碰撞避障
  • 实测在未知复杂环境仍能高速飞行,对门位误差容忍度高
  • 适合做真实无人机竞速的鲁棒视觉导航系统研发者

现有基于强化学习的无人机竞速方法多针对固定无障碍赛道,难以泛化到未知、杂乱环境。根本挑战在于需平衡飞行速度与避障、可行空间有限导致策略探索易陷入局部最优,以及深度图中门与障碍物感知模糊——尤其当门位置仅粗略指定时。为此,我们提出两阶段学习框架:初始软碰撞训练阶段保留策略探索以实现高速飞行,随后硬碰撞精修阶段强制鲁棒避障。采用自适应噪声增强课程与非对称演员-评论家架构,逐步引导策略从依赖门状态信息转向基于深度视觉输入。进一步引入Lipschitz约束并集成赛道原型生成器,提升运动稳定性和跨环境泛化能力。通过大量仿真与消融实验评估,并在计算受限四旋翼上进行真实世界验证。系统实现敏捷飞行的同时对门位误差保持鲁棒,构建了一个可在多样、部分未知且杂乱环境中运行的可泛化无人机竞速框架。

原文摘要 · Abstract (English)

Most reinforcement learning(RL)-based methods for drone racing target fixed, obstacle-free tracks, leaving the generalization to unknown, cluttered environments largely unaddressed. This challenge stems from the need to balance racing speed and collision avoidance, limited feasible space causing policy exploration trapped in local optima during training, and perceptual ambiguity between gates and obstacles in depth maps-especially when gate positions are only coarsely specified. To overcome these issues, we propose a two-phase learning framework: an initial soft-collision training phase that preserves policy exploration for high-speed flight, followed by a hard-collision refinement phase that enforces robust obstacle avoidance. An adaptive, noise-augmented curriculum with an asymmetric actor-critic architecture gradually shifts the policy's reliance from privileged gate-state information to depth-based visual input. We further impose Lipschitz constraints and integrate a track-primitive generator to enhance motion stability and cross-environment generalization. We evaluate our framework through extensive simulation and ablation studies, and validate it in real-world experiments on a computationally constrained quadrotor. The system achieves agile flight while remaining robust to gate-position errors, developing a generalizable drone racing framework with the capability to operate in diverse, partially unknown and cluttered environments. https://yufengsjtu.github.io/MasterRacing.github.io/

无人机竞速强化学习视觉导航鲁棒控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。