arXiv:2503.23975cs.RO2025-03被引 2

融合强化学习与符号距离场的移动机械臂实时全身运动规划框架

A Reactive Framework for Whole-Body Motion Planning of Mobile Manipulators Combining Reinforcement Learning and SDF-Constrained Quadratic Programmi

  • 用贝叶斯分布式强化学习提升价值估计精度和收敛速度
  • 结合符号距离场约束的二次规划,显著降低规划时间并提高成功率
  • 适合复杂动态环境中需快速安全响应的机器人系统

作为具身人工智能的重要分支,移动机械臂在智能服务中应用日益广泛,但其冗余自由度在复杂环境中的高效运动规划仍面临挑战。本文提出一种混合学习与优化的反应式全身运动规划框架。我们设计了贝叶斯分布式软演员-评论家(Bayes-DSAC)算法,以提升价值估计质量与学习收敛性能;同时引入基于符号距离场(SDF)约束的二次规划方法,增强避障动作的安全性。实验对比标准基准测试结果表明,所提框架显著提升了反应式全身运动规划效率,减少了规划时间,并提高了运动规划成功率。此外,所提出的强化学习方法确保了在全身规划任务中快速的学习过程。该新框架使移动机械臂能更安全、高效地适应复杂环境。

原文摘要 · Abstract (English)

As an important branch of embodied artificial intelligence, mobile manipulators are increasingly applied in intelligent services, but their redundant degrees of freedom also limit efficient motion planning in cluttered environments. To address this issue, this paper proposes a hybrid learning and optimization framework for reactive whole-body motion planning of mobile manipulators. We develop the Bayesian distributional soft actor-critic (Bayes-DSAC) algorithm to improve the quality of value estimation and the convergence performance of the learning. Additionally, we introduce a quadratic programming method constrained by the signed distance field to enhance the safety of the obstacle avoidance motion. We conduct experiments and make comparison with standard benchmark. The experimental results verify that our proposed framework significantly improves the efficiency of reactive whole-body motion planning, reduces the planning time, and improves the success rate of motion planning. Additionally, the proposed reinforcement learning method ensures a rapid learning process in the whole-body planning task. The novel framework allows mobile manipulators to adapt to complex environments more safely and efficiently.

运动规划强化学习机械臂SDF

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。