用逆强化学习让无人机在复杂环境里毫秒级规划路径,无需分模块设计。
RAPID: Robust and Agile Planner Using Inverse Reinforcement Learning for Vision-Based Drone Navigation
- 基于逆强化学习构建视觉导航框架,减少仿真交互次数。
- 真实飞行中平均速度达7米/秒,最高速度8.8米/秒。
- 训练仅在仿真中完成,直接部署于真实场景无需微调。
本文提出一种基于学习的视觉导航规划器,用于在复杂环境中实现敏捷无人机飞行。该规划器可在毫秒级生成无碰撞航点,使无人机无需独立的感知、建图和规划模块即可完成高机动飞行。现有基于学习的方法如行为克隆(BC)易受专家模仿局限导致误差累积,强化学习(RL)则面临奖励函数设计困难与样本效率低的问题。为此,本文提出基于逆强化学习(IRL)的高速视觉导航框架,通过IRL降低对仿真环境的交互需求,提升高维空间处理能力,同时保持RL策略的鲁棒性。采用基于运动基元的路径规划算法,利用多样化环境中的特权地图数据收集专家数据集,确保场景覆盖全面。结合专家数据与智能体在仿真中交互获得的学习数据,共同训练出跨多种状态的鲁棒奖励函数与策略。尽管训练仅在仿真环境进行,该方法可直接应用于真实场景而无需额外训练或调参。在仿真与真实环境(包括森林与多种结构)中均验证了性能表现。真实飞行实验中,所训练策略达到平均7米/秒、最高8.8米/秒的速度。据我们所知,这是首个成功将IRL框架应用于高速无人机视觉导航的工作。
原文摘要 · Abstract (English)
This paper introduces a learning-based visual planner for agile drone flight in cluttered environments. The proposed planner generates collision-free waypoints in milliseconds, enabling drones to perform agile maneuvers in complex environments without building separate perception, mapping, and planning modules. Learning-based methods, such as behavior cloning (BC) and reinforcement learning (RL), demonstrate promising performance in visual navigation but still face inherent limitations. BC is susceptible to compounding errors due to limited expert imitation, while RL struggles with reward function design and sample inefficiency. To address these limitations, this paper proposes an inverse reinforcement learning (IRL)-based framework for high-speed visual navigation. By leveraging IRL, it is possible to reduce the number of interactions with simulation environments and improve capability to deal with high-dimensional spaces while preserving the robustness of RL policies. A motion primitive-based path planning algorithm collects an expert dataset with privileged map data from diverse environments, ensuring comprehensive scenario coverage. By leveraging both the acquired expert and learner dataset gathered from the agent's interactions with the simulation environments, a robust reward function and policy are learned across diverse states. While the proposed method is trained in a simulation environment only, it can be directly applied to real-world scenarios without additional training or tuning. The performance of the proposed method is validated in both simulation and real-world environments, including forests and various structures. The trained policy achieves an average speed of 7 m/s and a maximum speed of 8.8 m/s in real flight experiments. To the best of our knowledge, this is the first work to successfully apply an IRL framework for high-speed visual navigation of drones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。