arXiv:2412.20350cs.LGcs.RO2024-12CoRL被引 6

提出新算法,安全优化高维机器人控制。

Safe Bayesian Optimization for the Control of High-Dimensional Embodied Systems

  • 用局部乐观策略高效探索高维空间。
  • 在数百至数千维下保持安全概率与违规上限。
  • 适合高维生物力学系统在线安全优化。

学习运动是动物和机器人的核心目标,而在具身系统中优化控制策略时,安全性至关重要。对于人体或人形机器人等复杂任务,高维参数空间使安全优化更加困难。现有安全探索算法在高维输入空间下效率低下甚至不可行,而多数高维约束优化方法也忽视了搜索过程中的安全性。本文提出高维安全贝叶斯优化(HdSafeBO),一种基于局部乐观探索的新方法,可在概率性安全约束下处理高维采样问题。通过等距嵌入技术,HdSafeBO能应对从几百到上千维度的问题,同时提供概率性安全保证和累积安全违规上限。据我们所知,HdSafeBO是首个能在高安全概率下优化高维肌肉骨骼系统控制的算法。我们还通过神经刺激诱导的人体运动在线安全优化,验证了其实际应用潜力。

原文摘要 · Abstract (English)

Learning to move is a primary goal for animals and robots, where ensuring safety is often important when optimizing control policies on the embodied systems. For complex tasks such as the control of human or humanoid control, the high-dimensional parameter space adds complexity to the safe optimization effort. Current safe exploration algorithms exhibit inefficiency and may even become infeasible with large high-dimensional input spaces. Furthermore, existing high-dimensional constrained optimization methods neglect safety in the search process. In this paper, we propose High-dimensional Safe Bayesian Optimization with local optimistic exploration (HdSafeBO), a novel approach designed to handle high-dimensional sampling problems under probabilistic safety constraints. We introduce a local optimistic strategy to efficiently and safely optimize the objective function, providing a probabilistic safety guarantee and a cumulative safety violation bound. Through the use of isometric embedding, HdSafeBO addresses problems ranging from a few hundred to several thousand dimensions while maintaining safety guarantees. To our knowledge, HdSafeBO is the first algorithm capable of optimizing the control of high-dimensional musculoskeletal systems with high safety probability. We also demonstrate the real-world applicability of HdSafeBO through its use in the safe online optimization of neural stimulation induced human motion control.

强化学习安全优化高维控制贝叶斯优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。