arXiv:2411.00659cs.ROmath.OC2024-11被引 1

为含接触的机器人系统设计鲁棒控制器,解决跳跃动态与随机切换难题。

Path Integral Control for Hybrid Dynamical Systems

  • 基于路径积分框架处理混合系统随机跳变与状态不连续问题
  • 在多种系统上验证,控制性能优于传统方法,采样并行化提升效率
  • 适合研究复杂动力学系统控制的学者,尤其关注机器人接触场景

本文提出一种新范式,用于求解不确定性下混合动力系统的最优控制问题。具有环境接触特性的机器人系统可建模为混合系统。在扰动影响下,其控制器设计因不连续跳跃动力学、模式变化导致的状态维数不一致以及噪声引起的跳跃时机与状态波动而变得复杂。我们将该问题建模为带有混合转换约束的随机控制问题,并提出混合路径积分(H-PI)框架以获得最优控制器。尽管随机路径样本中存在模式变化,我们证明了不同漂移项下的混合路径分布比值仍类似于平滑路径分布。进而表明,最优控制器可通过带混合约束的路径积分求得。为此引入针对混合动力学约束路径分布的重要性采样,以降低路径积分评估方差,并利用最近提出的混合迭代线性二次调节器(H-iLQR)控制器生成低方差路径分布提议。所提方法在多个混合系统上通过数值实验验证,并进行了广泛的消融研究。所有采样过程均在图形处理器(GPU)上并行执行。

原文摘要 · Abstract (English)

This work introduces a novel paradigm for solving optimal control problems for hybrid dynamical systems under uncertainties. Robotic systems having contact with the environment can be modeled as hybrid systems. Controller design for hybrid systems under disturbances is complicated by the discontinuous jump dynamics, mode changes with inconsistent state dimensions, and variations in jumping timing and states caused by noise. We formulate this problem into a stochastic control problem with hybrid transition constraints and propose the Hybrid Path Integral (H-PI) framework to obtain the optimal controller. Despite random mode changes across stochastic path samples, we show that the ratio between hybrid path distributions with varying drift terms remains analogous to the smooth path distributions. We then show that the optimal controller can be obtained by evaluating a path integral with hybrid constraints. Importance sampling for path distributions with hybrid dynamics constraints is introduced to reduce the variance of the path integral evaluation, where we leverage the recently developed Hybrid iterative-Linear-Quadratic-Regulator (H-iLQR) controller to induce a hybrid path distribution proposal with low variance. The proposed method is validated through numerical experiments on various hybrid systems and extensive ablation studies. All the sampling processes are conducted in parallel on a Graphics Processing Unit (GPU).

最优控制混合系统路径积分机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。