arXiv:2409.05344cs.ROcs.AI2024-09中稿 · ICRA被引 19

用Transformer强化学习实现可泛化的3D物品打包,适配不同尺寸箱子。

GOPT: Generalizable Online 3D Bin Packing via Transformer-based Deep Reinforcement Learning

  • 基于Transformer设计打包候选空间与箱体特征融合机制。
  • 在多种箱体尺寸下表现优于基线方法,泛化能力强。
  • 已实现在机器人上的部署,适合工业自动化场景。

机器人物品打包在物流与自动化领域有广泛应用,常被研究者建模为在线3D Bin Packing问题(3D-BPP)。然而现有基于深度强化学习(DRL)的方法主要聚焦于特定打包环境下的性能提升,忽视了跨不同箱体尺寸环境的泛化能力。为此,本文提出GOPT,一种基于Transformer的通用在线3D Bin Packing方法。首先,设计放置生成器模块,生成有限的放置候选子空间及箱体表征;其次,提出打包Transformer,融合物品与箱体特征,识别待装物品与箱体内可用子空间间的空间关联。两者结合使GOPT具备对不同尺寸箱体进行推理的能力。大量实验表明,GOPT不仅在性能上超越基线方法,且展现出优异的泛化能力。此外,机器人部署验证了该方法在真实场景中的实用性。源代码将公开于https://github.com/Xiong5Heng/GOPT。

原文摘要 · Abstract (English)

Robotic object packing has broad practical applications in the logistics and automation industry, often formulated by researchers as the online 3D Bin Packing Problem (3D-BPP). However, existing DRL-based methods primarily focus on enhancing performance in limited packing environments while neglecting the ability to generalize across multiple environments characterized by different bin dimensions. To this end, we propose GOPT, a generalizable online 3D Bin Packing approach via Transformer-based deep reinforcement learning (DRL). First, we design a Placement Generator module to yield finite subspaces as placement candidates and the representation of the bin. Second, we propose a Packing Transformer, which fuses the features of the items and bin, to identify the spatial correlation between the item to be packed and available sub-spaces within the bin. Coupling these two components enables GOPT's ability to perform inference on bins of varying dimensions. We conduct extensive experiments and demonstrate that GOPT not only achieves superior performance against the baselines, but also exhibits excellent generalization capabilities. Furthermore, the deployment with a robot showcases the practical applicability of our method in the real world. The source code will be publicly available at https://github.com/Xiong5Heng/GOPT.

3D打包强化学习机器人Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。