用强化学习实现四旋翼快速精准倒飞,提升控制精度与鲁棒性。
AcroRL: Learning Aggressive Quadrotor Inversion using Bidirectional Thrust

- 通过双方向推力与强化学习策略,自适应调节轨迹完成倒飞
- 位置误差降低32%,稳定时间缩短57%,优于现有优化方法
- 支持真实飞行器倒飞与后续轨迹控制,开源可复现
双向推力为四旋翼提供了第二个平衡状态和更强的控制能力,拓展了激进机动空间,实现了倒飞、停靠和感知。以往基于几何的控制方法虽通过霍普夫纤维化姿态表示支持双向推力,但在倒飞过程中仍面临执行器饱和和电机反转延迟问题,需依赖启发式推力姿态调度和航点调优。本文提出一种基于学习的框架,通过调节恒定参考轨迹,在保持位置约束的同时完成紧凑的倒飞动作,且兼容传统轨迹生成与不同飞行阶段的跟踪控制。分别使用强化学习训练了从正常到倒飞及倒飞回正常的两套策略。在基于JAX的仿真中,所提方法在所有对比基线中实现了最低的位置偏差与最快收敛速度,相较最强的优化基线,位置均方根误差(RMSE)降低32%,稳定时间减少57%。硬件实验验证了多种偏航配置下的成功倒飞,位置RMSE低于0.35米,并展示了在两个飞行状态间进行圆形飞行的下游轨迹生成与控制兼容性。此外,本文还提供该框架的开源实现。
原文摘要 · Abstract (English)
Bidirectional thrust grants quadrotors a second equilibrium condition and increased control authority, expanding the envelope of possible aggressive maneuvers and enabling inverted flight, perching, and sensing. Prior geometric control approaches extend differential flatness through Hopf fibration-based attitude representations to support bidirectional thrust, but struggle with actuator saturation and motor reversal delay during inversions, requiring heuristic thrust posture scheduling and waypoint tuning. We propose a learning-based framework that modulates a constant reference trajectory to perform compact, position-constrained quadrotor inversions while remaining compatible with traditional trajectory generation and tracking across flight regimes. Separate policies are trained via reinforcement learning for nominal-to-inverted and inverted-to-nominal transitions. In JAX-based simulation, the proposed method achieves the lowest position deviation and settling time across all evaluated baselines, reducing position root mean square error (RMSE) by 32% and settling time by 57% relative to the strongest optimization-based baseline. Hardware experiments demonstrate successful inversion across multiple yaw configurations with position RMSE below 0.35m, and compatibility with downstream trajectory generation and control through circular flight in both regimes. Additionally, we provide an open-source implementation of the proposed framework.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。