arXiv:2511.19932cs.RO2025-11被引 1

用仿真与真实数据协同训练,让机器人装箱更稳。

Collaborate sim and real: Robot Bin Packing Learning in Real-world and Physical Engine

  • 结合物理仿真与真实反馈,动态调整参数提升泛化能力。
  • 实测显示装箱坍塌率降低35%,优于基线方法。
  • 适合物流、仓储等需稳定堆叠的工业场景。

三维装箱问题在工业中有广泛应用,现有方法多将其视为离散静态过程,但实际应用中存在连续重力作用。这种理想化简化导致部署时出现不稳定装箱。借助物理引擎仿真可模拟连续重力效应,训练强化学习(RL)智能体以改善堆叠稳定性。然而,由于真实物体物理属性(如摩擦系数、弹性、重量分布不均)的动态变化,仍存在仿真到现实的差距。为此,我们提出一种混合强化学习框架,融合物理仿真与真实数据反馈。首先在仿真中使用领域随机化,使智能体接触多种物理参数,增强泛化能力;其次,利用真实部署反馈对智能体进行微调,进一步降低坍塌率。大量实验表明,该方法在仿真和真实场景中均实现更低的坍塌率。大规模物流系统部署验证了其有效性,相比基线方法装箱坍塌率降低35%。

原文摘要 · Abstract (English)

The 3D bin packing problem, with its diverse industrial applications, has garnered significant research attention in recent years. Existing approaches typically model it as a discrete and static process, while real-world applications involve continuous gravity-driven interactions. This idealized simplification leads to infeasible deployments (e.g., unstable packing) in practice. Simulations with physical engine offer an opportunity to emulate continuous gravity effects, enabling the training of reinforcement learning (RL) agents to address such limitations and improve packing stability. However, a simulation-to-reality gap persists due to dynamic variations in physical properties of real-world objects, such as various friction coefficients, elasticity, and non-uniform weight distributions. To bridge this gap, we propose a hybrid RL framework that collaborates with physical simulation with real-world data feedback. Firstly, domain randomization is applied during simulation to expose agents to a spectrum of physical parameters, enhancing their generalization capability. Secondly, the RL agent is fine-tuned with real-world deployment feedback, further reducing collapse rates. Extensive experiments demonstrate that our method achieves lower collapse rates in both simulated and real-world scenarios. Large-scale deployments in logistics systems validate the practical effectiveness, with a 35\% reduction in packing collapse compared to baseline methods.

机器人强化学习装箱优化仿真-现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。