分步清除障碍物,让机器人在杂乱中高效找到目标物。
Learning Object-Centric Spatial Reasoning for Sequential Manipulation in Cluttered Environments
- 用轻量级Transformer分离空间推理与动作执行
- 模拟中部分遮挡成功率达97.6%,完全遮挡达90.0%
- 无需重训,直接部署到真实机器人上
杂乱环境中的机器人操作是自动化关键挑战。现有大规模端到端模型虽能力突出,但数据效率低、模块性差。本文提出Unveiler框架,将高层空间推理与底层动作执行解耦。核心为轻量级Transformer-based Spatial Relationship Encoder(SRE),逐次识别最关键障碍物;决策交由旋转不变的动作解码器执行。该架构参数少、推理快,且在密集遮挡中显著优于经典端到端策略与大模型基线。SRE通过两阶段训练:先用启发式示范进行模仿学习初始化,再经PPO微调,发现超越启发式的清除策略。仿真结果表明,部分遮挡下成功率最高达97.6%,完全遮挡下达90.0%。此外,SRE的空间推理可零样本迁移至真实场景,并在物理机器人上验证,仅需几何校准,无须重训练任何学习组件。
原文摘要 · Abstract (English)
Robotic manipulation in cluttered environments presents a critical challenge for automation. Recent large-scale, end-to-end models demonstrate impressive capabilities but often lack the data efficiency and modularity required for retrieving objects in dense clutter. In this work, we argue for a paradigm of specialized, decoupled systems and present Unveiler, a framework that explicitly separates high-level spatial reasoning from low-level action execution. Unveiler's core is a lightweight, transformer-based Spatial Relationship Encoder (SRE) that sequentially identifies the most critical obstacle for removal. This discrete decision is then passed to a rotation-invariant Action Decoder for execution. We demonstrate that this decoupled architecture is not only more computationally efficient in terms of parameter count and inference time, but also significantly outperforms both classic end-to-end policies and modern, large-model-based baselines in retrieving targets from dense clutter. The SRE is trained in two stages: imitation learning from heuristic demonstrations provides sample-efficient initialization, after which PPO fine-tuning enables the policy to discover removal strategies that surpass the heuristic in dense clutter. Our results, achieving up to 97.6\% success in partially occluded and 90.0\% in fully occluded scenarios in simulation, make a case for the power of specialized, object-centric reasoning in complex manipulation tasks. Additionally, we demonstrate that the SRE's spatial reasoning transfers zero-shot to real scenes, and validate the full system on a physical robot requiring only geometric workspace calibration; no learned components are retrained.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。