arXiv:2510.14768cs.RO2025-10

让机械手在抓物掉落时自动恢复,还能保持任务连续性。

CADRE: Dynamic Catching via Implicit Contact Descriptors and Task-Appropriate Recovery Affordances

  • 用隐式接触特征捕捉手指与物体的对应关系
  • 训练效率提升,成功率显著高于仅用姿态或点云的方法
  • 无需额外训练即可应对不同形状的新物体

现实中的灵巧操作常遭遇意外扰动,可能导致物体掉落等灾难性失败。本文聚焦于在物体仍在抓取范围内时动态捕捉并恢复的任务,关键在于使系统重置到适合继续主任务的状态。提出接触感知动态恢复框架CADRE,引入受神经描述场(NDF)启发的模块,提取隐式接触特征;基于这些特征设计隐式恢复效用函数,引导智能体恢复至任务相关的有利状态。相比仅依赖物体位姿或点云的方法,NDF能直接推理手指与物体的对应关系,更准确地设定强化学习的恢复目标。实验表明,融合接触特征可提升训练效率、加速收敛并提高成功率;此外,CADRE在零样本条件下对具有不同几何形状的新物体也具备泛化能力。

原文摘要 · Abstract (English)

Real-world dexterous manipulation often encounters unexpected errors and disturbances, which can lead to catastrophic failures, such as dropping the manipulated object. To address this challenge, we focus on the problem of catching a falling object while it remains within grasping range and, importantly, resetting the system to a configuration favorable for resuming the primary manipulation task. We propose Contact-Aware Dynamic Recovery (CADRE), a reinforcement learning framework that incorporates a Neural Descriptor Field (NDF)-inspired module to extract implicit contact features. Building on these contact features, we introduce an Implicit Recovery Affordance function to encourage recovery to task-appropriate states. Compared to methods that rely solely on object pose or point cloud input, NDFs can directly reason about finger-object correspondence and better establish a recovery target for RL training. Our experiments show that incorporating contact features improves training efficiency, enhances convergence performance for RL training, and ultimately leads to more successful recoveries. Additionally, we demonstrate that CADRE can generalize zero-shot to unseen objects with different geometries.

灵巧操作强化学习动态恢复接触感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。