arXiv:2511.21264cs.RO2025-11被引 1

用物理仿真优化双臂操作,实时且能跨域迁移。

Sampling-Based Optimization with Parallelized Physics Simulator for Bimanual Manipulation

  • 基于采样优化框架,用GPU加速物理引擎评估交互。
  • 在障碍物环境中完成复杂球体传送任务,实现实时运行。
  • 适合需要高鲁棒性与真实世界部署的机器人控制研究者。

近年来,双臂操作成为机器人领域的热点,端到端学习已成为解决双臂任务的主流方法。然而,这类学习方法在新场景下尤其是杂乱环境中的泛化能力较差。本文提出一种替代范式:基于采样的优化框架,利用GPU加速的物理模拟器作为世界模型。我们设计了一种定制化的模型预测路径积分控制(MPPI)算法,通过精心设计的任务特定代价函数引导,并借助GPU加速的MuJoCo高效评估机器人-物体交互。该方法成功解决了PerAct²基准中更复杂的任务,如需穿越障碍物路径的球体点对点转移。此外,方法在消费级GPU上实现实时性能,并通过MuJoCo的独特特性支持有效的仿真到现实迁移。论文还进行了样本复杂度和鲁棒性的统计分析,量化了方法表现。项目主页见:https://sites.google.com/view/bimanualakslabunitartu。

原文摘要 · Abstract (English)

In recent years, dual-arm manipulation has become an area of strong interest in robotics, with end-to-end learning emerging as the predominant strategy for solving bimanual tasks. A critical limitation of such learning-based approaches, however, is their difficulty in generalizing to novel scenarios, especially within cluttered environments. This paper presents an alternative paradigm: a sampling-based optimization framework that utilizes a GPU-accelerated physics simulator as its world model. We demonstrate that this approach can solve complex bimanual manipulation tasks in the presence of static obstacles. Our contribution is a customized Model Predictive Path Integral Control (MPPI) algorithm, \textbf{guided by carefully designed task-specific cost functions,} that uses GPU-accelerated MuJoCo for efficiently evaluating robot-object interaction. We apply this method to solve significantly more challenging versions of tasks from the PerAct$^{2}$ benchmark, such as requiring the point-to-point transfer of a ball through an obstacle course. Furthermore, we establish that our method achieves real-time performance on commodity GPUs and facilitates successful sim-to-real transfer by leveraging unique features within MuJoCo. The paper concludes with a statistical analysis of the sample complexity and robustness, quantifying the performance of our approach. The project website is available at: https://sites.google.com/view/bimanualakslabunitartu .

双臂操作物理仿真强化学习实时控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。