让无人机从任意起点到终点最快飞行,还能稳定悬停。
Simultaneous learning of state-to-state minimum-time planning and control
- 用强化学习同时学飞行路径和控制策略
- 仿真和实测都比传统方法快,能在单板机运行
- 适合想做通用无人机快速导航的工程师
本文解决无人机在任意起止状态间实现最短时间飞行的通用化学习问题,兼顾高速机动与稳定悬停。传统方法(如自主无人机竞速)虽速度快,但仅适用于预设赛道,难以推广。为此,我们提出基于强化学习的框架,同时学习状态到状态的最短时间规划与控制,并具备任意状态间飞行的泛化能力。方法利用点质量模型(PMM)轨迹作为代理奖励,逼近真实最优飞行目标,并采用课程学习策略高效扩展训练过程以实现泛化。通过仿真验证,对比了非线性模型预测控制(NMPC)跟踪PMM轨迹的效果,并进行消融实验评估课程学习影响。最终,真实环境实验验证了所学策略在户外场景下的鲁棒性,且可在小型ARM单板计算机上运行。
原文摘要 · Abstract (English)
This paper tackles the challenge of learning a generalizable minimum-time flight policy for UAVs, capable of navigating between arbitrary start and goal states while balancing agile flight and stable hovering. Traditional approaches, particularly in autonomous drone racing, achieve impressive speeds and agility but are constrained to predefined track layouts, limiting real-world applicability. To address this, we propose a reinforcement learning-based framework that simultaneously learns state-to-state minimum-time planning and control and generalizes to arbitrary state-to-state flights. Our approach leverages Point Mass Model (PMM) trajectories as proxy rewards to approximate the true optimal flight objective and employs curriculum learning to scale the training process efficiently and to achieve generalization. We validate our method through simulation experiments, comparing it against Nonlinear Model Predictive Control (NMPC) tracking PMM-generated trajectories and conducting ablation studies to assess the impact of curriculum learning. Finally, real-world experiments confirm the robustness of our learned policy in outdoor environments, demonstrating its ability to generalize and operate on a small ARM-based single-board computer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。