arXiv:2606.13842cs.RO2026-06

用核表示法实现四旋翼在变化干扰下的快速自适应控制。

Efficient Domain-Adaptive Policy Learning via Kernel Representation with Application to Quadrotor Control under Non-Stationary Disturbances

论文配图:Efficient Domain-Adaptive Policy Learning via Kernel Representation with Application to Quadrotor Control under Non-Stationary Disturbances
图 1 · 摘自论文原文
  • 用随机傅里叶特征构建可微分的干扰核模型,支持高效离线训练。
  • 离线训练仅需50秒,硬件部署时实时更新核参数实现在线适应。
  • 适用于风扰、载荷变化等非平稳干扰场景,实测验证于Crazyflie平台。

本文提出一种基于核表示的高效领域自适应策略学习算法。由于需要在离线训练中充分建模复杂的仿真到现实差距,同时保证在线部署时快速适应,因此挑战巨大。例如,四旋翼可能遭遇随时间变化的非平稳干扰,如突发风力、载荷转移或有无地面效应的飞行模式切换。为此,我们采用基于随机傅里叶特征的可微分核近似来建模未知干扰。离线训练阶段,通过随机采样核系数与带宽参数生成多样化的干扰场景,并利用可微分仿真和解析梯度优化控制策略,仅需50秒即可在RTX 4090 GPU上完成。部署阶段,通过在线最小二乘估计实时更新核系数与带宽,实现对非平稳环境的即时适应。我们在高保真数值仿真和Crazyflie硬件实验中评估该方法,面对复杂气动效应、风扰、地面效应及载荷波动等多种干扰,均表现出优异的轨迹跟踪性能。

原文摘要 · Abstract (English)

We present an algorithm for efficient domain-adaptive policy learning via kernel representations. Learning domain-adaptive policies is challenging since it requires an environment representation that is both sufficiently expressive to model complex sim-to-real gaps during offline training, and computationally efficient enough to support rapid online adaptation during deployment. For instance, a quadrotor may encounter time-varying, non-stationary disturbances, such as sudden gusts of wind, payload shifts, or transitions between distinct flight regimes with and without ground effects. To address these challenges, we model unknown disturbances using a differentiable kernel approximation based on random Fourier features. During the offline training phase, we randomly sample kernel coefficients and bandwidth parameters to generate a rich diversity of disturbance profiles. We then optimize the control policy via differentiable simulation with analytical gradients, a process that takes only 50 seconds of training time on an RTX 4090 GPU. During hardware deployment, the policy adapts to non-stationary environments in real time by updating both the kernel coefficients and bandwidth through online least-squares estimation. We evaluate our method on quadrotor trajectory tracking tasks across high-fidelity numerical simulations and hardware experiments using Crazyflie, subjected to various disturbances, including complex aerodynamic effects, wind, ground effects, and payload fluctuations.

强化学习自适应控制四旋翼核方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。