arXiv:2504.04421cs.ROcs.LG2025-04被引 11

用树状结构提升3D装箱规划效率,支持复杂工业约束。

Deliberate Planning of 3D Bin Packing on Packing Configuration Trees

  • 构建包装配置树(PCT)表征装箱状态与动作空间,适配深度强化学习。
  • 在真实场景下实现每箱10秒装填,单托盘平均装19箱、空间利用率57.4%。
  • 可应对大规模装箱及多种实际约束,适合工业自动化部署。

在线3D装箱问题(3D-BPP)在工业自动化中应用广泛。现有方法通常受限于空间离散化分辨率,或难以处理复杂实际约束。本文提出基于新型层次化表示——包装配置树(PCT)的强化学习框架,全面描述装箱的状态与动作空间,支持基于深度强化学习(DRL)的策略学习。动作空间大小与叶节点数量成正比,使DRL模型在连续解空间下仍易于训练且性能优异。进一步发现PCT作为树状规划器,在解决具有工业意义的装箱问题上潜力显著,包括大规模装箱及多种变体。提出递归装箱方法将大任务分解为子树,结合空间集成机制融合局部解生成全局方案。针对含额外决策变量的变体(如前瞻、缓冲、离线装箱),设计统一规划框架实现开箱即用。大量实验表明,该方法优于现有在线BPP基线,能灵活整合多种实际约束。规划过程在大规模问题和多样化设置中表现优异。开发了一款用于工业仓储的真实装箱机器人,考虑放置限制与运输稳定性。该机器人在未保护托盘上每箱耗时10秒,平均每托盘装19箱,对大尺寸箱子空间利用率达57.4%。

原文摘要 · Abstract (English)

Online 3D Bin Packing Problem (3D-BPP) has widespread applications in industrial automation. Existing methods usually solve the problem with limited resolution of spatial discretization, and/or cannot deal with complex practical constraints well. We propose to enhance the practical applicability of online 3D-BPP via learning on a novel hierarchical representation, packing configuration tree (PCT). PCT is a full-fledged description of the state and action space of bin packing which can support packing policy learning based on deep reinforcement learning (DRL). The size of the packing action space is proportional to the number of leaf nodes, making the DRL model easy to train and well-performing even with continuous solution space. We further discover the potential of PCT as tree-based planners in deliberately solving packing problems of industrial significance, including large-scale packing and different variations of BPP setting. A recursive packing method is proposed to decompose large-scale packing into smaller sub-trees while a spatial ensemble mechanism integrates local solutions into global. For different BPP variations with additional decision variables, such as lookahead, buffering, and offline packing, we propose a unified planning framework enabling out-of-the-box problem solving. Extensive evaluations demonstrate that our method outperforms existing online BPP baselines and is versatile in incorporating various practical constraints. The planning process excels across large-scale problems and diverse problem variations. We develop a real-world packing robot for industrial warehousing, with careful designs accounting for constrained placement and transportation stability. Our packing robot operates reliably and efficiently on unprotected pallets at 10 seconds per box. It achieves averagely 19 boxes per pallet with 57.4% space utilization for relatively large-size boxes.

3D装箱强化学习工业自动化树结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。