用强化学习提升仿生飞行器实时控制精度,最高达2500Hz。
Real Time Control of Tandem-Wing Experimental Platform Using Concerto Reinforcement Learning
- 融合经典控制与强化学习,采用时间交错架构实现快速收敛。
- 在多种扰动下控制频率超2500Hz,跟踪性能提升18.3%至60.7%。
- 适合高动态仿生飞行器、实时控制系统研发人员参考。
本文提出CRL2RT算法,用于提升直驱双翼实验平台(DDTWEP)的实时控制性能。受蜻蜓飞行启发,DDTWEP的双翼结构引发非线性且不稳定的气动耦合,导致俯仰、滚转和偏航动作中负载行为复杂,在高频(2000 Hz)下难以稳定控制。为此,我们设计了结合经典控制与强化学习控制器的时序交错架构,并引入规则驱动的策略组合器,确保有限时间内收敛且具备单次生命周期自适应能力。实验结果表明,在不同拍频与偏航干扰条件下,CRL2RT在标准CPU上实现超过2500 Hz的控制频率。当与PID、自适应PID及模型参考自适应控制(MRAC)集成时,跟踪性能提升18.3%至60.7%。这些结果验证了该方法在复杂实时控制场景中的广泛适用性与优越表现,突破现有控制策略局限,推动仿生飞行器高效稳健的实时控制发展。
原文摘要 · Abstract (English)
This paper introduces the CRL2RT algorithm, an advanced reinforcement learning method aimed at improving the real-time control performance of the Direct-Drive Tandem-Wing Experimental Platform (DDTWEP). Inspired by dragonfly flight, DDTWEP's tandem wing structure causes nonlinear and unsteady aerodynamic interactions, leading to complex load behaviors during pitch, roll, and yaw maneuvers. These complexities challenge stable motion control at high frequencies (2000 Hz). To overcome these issues, we developed the CRL2RT algorithm, which combines classical control elements with reinforcement learning-based controllers using a time-interleaved architecture and a rule-based policy composer. This integration ensures finite-time convergence and single-life adaptability. Experimental results under various conditions, including different flapping frequencies and yaw disturbances, show that CRL2RT achieves a control frequency surpassing 2500 Hz on standard CPUs. Additionally, when integrated with classical controllers like PID, Adaptive PID, and Model Reference Adaptive Control (MRAC), CRL2RT enhances tracking performance by 18.3% to 60.7%. These findings demonstrate CRL2RT's broad applicability and superior performance in complex real-time control scenarios, validating its effectiveness in overcoming existing control strategy limitations and advancing robust, efficient real-time control for biomimetic aerial vehicles.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。