用强化学习让机器人自动补全积木组装,无需人工指导。
AssemblyComplete: 3D Combinatorial Construction with Deep Reinforcement Learning
- 分两阶段强化学习框架,结合稳定结构库与动作掩码。
- 在多种场景中实现高效且稳定的组装,支持未见积木类型。
- 适合需要自主装配的机器人系统研究者参考。
机器人自主适应现实世界协作任务的关键目标是实现自动装配。本文提出3D组合式装配补全方法,以积木单元(如乐高砖块)为例。由于可能的组合方式多样及复杂的物理约束(如无碰撞、结构稳定、库存限制等),组合装配极具挑战性。为此,我们设计了一个双阶段深度强化学习框架,使机器人既能理解不完整装配的目标,又能学习构建策略完成装配。机器人通过查询稳定物体库来辅助装配推断并引导学习;同时引入动作掩码机制,排除违反物理约束的无效动作。实验表明,该框架在多种装配场景中具备可行性与鲁棒性,能有效完成真实场景下的装配任务,兼顾解的质量与运行效率。此外,结果还显示其对未见过的、独特的物体类型也具备良好的推断与装配能力。
原文摘要 · Abstract (English)
A critical goal in robotics and autonomy is to teach robots to adapt to real-world collaborative tasks, particularly in automatic assembly. The ability of a robot to understand the original intent of an incomplete assembly and complete missing features without human instruction is valuable but challenging. This paper introduces 3D combinatorial assembly completion, which is demonstrated using combinatorial unit primitives (i.e., Lego bricks). Combinatorial assembly is challenging due to the possible assembly combinations and complex physical constraints (e.g., no brick collisions, structure stability, inventory constraints, etc.). To address these challenges, we propose a two-part deep reinforcement learning (DRL) framework that tackles teaching the robot to understand the objective of an incomplete assembly and learning a construction policy to complete the assembly. The robot queries a stable object library to facilitate assembly inference and guide learning. In addition to the robot policy, an action mask is developed to rule out invalid actions that violate physical constraints for object-oriented construction. We demonstrate the proposed framework's feasibility and robustness in a variety of assembly scenarios in which the robot satisfies real-life assembly with respect to both solution and runtime quality. Furthermore, results demonstrate that the proposed framework effectively infers and assembles incomplete structures for unseen and unique object types.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。