动态引导机械臂抓取,提升复杂任务成功率
AffordTrajDP: Dynamic Affordance-Guided Visuomotor Policy Learning for Robotic Manipulation

- 用物体位姿动态传播接触点,实现持续精准引导
- 在ManiSkill3上达70.0%成功率,领先基线17.8%
- 适合需要抗干扰和泛化能力的现实抓取场景
基于可操作性的模仿学习在机器人操作任务中表现优异,通过将视觉感知压缩为特定任务的几何约束(如固定接触点)。然而,常用的静态可操作性在精度要求高的任务或物体位置扰动下会失准,导致接触后轨迹漂移。为此,我们提出AffordTrajDP,一种通过物体中心的时间传播构建可操作性轨迹的动态框架,以指导渐进式操作过程。给定RGB-D观测,核心思想是:通过物体的SE(3)位姿作为自然传播介质,将检索到的锚点可操作性向前传播,生成时序一致、状态感知的可操作性轨迹,提供全程稳定引导。AffordTrajDP在ManiSkill3上达到70.0%平均成功率达,优于强基线最高17.8%。在Galaxea A1和UR7e机械臂上的真实世界实验验证了其对物体放置变化和外观差异的鲁棒性,涵盖StackCube、PickCup、AdapterInsertion、Ring-on-Peg、Put-in-Bowl和USB Insertion任务;已见与未见物体实例均测试,消融实验确认各组件贡献。
原文摘要 · Abstract (English)
Affordance-guided imitation learning has shown impressive performance in robotic manipulation tasks by compressing visual perception into task-specific geometric constraints (e.g., fixed contact points). However, the commonly used static affordances can become inconsistent in precision-critical tasks or under object location perturbations, leading to post-contact trajectory drift. To address this issue, we propose AffordTrajDP, a dynamic framework that constructs affordance trajectories via object-centric temporal propagation to guide the progressive manipulation process. Specifically, given an RGB-D observation, our core insight is that a retrieved anchor affordance, which captures the desired contact point between the end-effector and the target object, can be propagated forward via affordance propagation, using the object's SE(3) pose as a natural propagation medium, to yield an affordance trajectory that provides temporally consistent, state-aware guidance throughout execution. AffordTrajDP achieves 70.0% average success rate on ManiSkill3, outperforming strong baselines by up to 17.8%. Real-world experiments on Galaxea A1 and UR7e robotic arms, covering StackCube, PickCup, AdapterInsertion, Ring-on-Peg, Put-in-Bowl, and USB Insertion, further validate robustness under object placement variations and appearance changes, with seen and unseen object instances evaluated on Galaxea A1, and ablations confirm the contribution of each proposed component.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。