arXiv:2606.15133cs.ROcs.CV2026-06

让机械手通过物理接触自然操控可动物体,提升真实场景下的操作鲁棒性。

DragMesh-2: Physically Plausible Dexterous Hand-Object Interaction with Articulated Objects

论文配图:DragMesh-2: Physically Plausible Dexterous Hand-Object Interaction with Articulated Objects
图 1 · 摘自论文原文
  • 基于物理接触驱动,让可动部件运动由手部持续推拉自然产生。
  • 在7种可动物体上测试,接触力变化时仍保持高成功率和强鲁棒性。
  • 无需触觉反馈,通过物理信号增强训练,适合真实机器人应用。

灵巧操作可动物体对家庭、辅助及人形机器人操作至关重要,多指手可实现超越平行夹爪的柔顺接触。然而,可动物体操作不同于静态物体:目标部件无法直接驱动,其运动必须通过持续的物理手-物接触自然产生。这使得从以物体为中心的生成转向手驱动的灵巧交互极具挑战,因几何轨迹重放或开环执行无法建模所需接触动力学。此外,仅在固定动力学下训练的策略易过度拟合标准接触力,尤其在缺乏触觉或力反馈时,当接触力改变后性能会下降。为此,我们提出DragMesh-2,一种接触驱动的灵巧交互框架,将可动物体交互从物体中心生成扩展至手驱动的灵巧交互,其中可动部分的运动必须通过物理接触产生。我们进一步提出PICA,一种物理感知的接触感知训练机制,在不依赖触觉或力反馈的情况下向策略学习注入物理信号,显著提升在不同接触力下的鲁棒性和任务成功率。我们在多种阻尼条件与多类可动物体上进行系统评估,研究接触力变化下的鲁棒性,并提供一个纯几何的灵巧交互资源,以支持未来多模态操控与人形手-物交互研究。在7个GAPartNet物体上,DragMesh-2在接触力变化条件下表现出比对比方法更强的鲁棒性,同时在各类阻尼条件下保持高任务成功率。

原文摘要 · Abstract (English)

Dexterous interaction with articulated objects is important for household, assistive, and humanoid manipulation, where multi-finger hands can provide compliant contact patterns beyond parallel-jaw grasping. However, articulated-object manipulation differs from static-object manipulation: the target part cannot be directly actuated, and its motion must emerge through sustained physical hand--handle contact. This makes the transition from object-centric articulated generation to hand-driven dexterous hand--object interaction non-trivial, since geometric trajectory replay or open-loop execution does not model the contact dynamics required to move the articulated part. Moreover, policies trained only for task completion under fixed dynamics can overfit nominal contact loads, especially without tactile or force feedback, and may degrade when the contact load changes. To address these challenges, we present DragMesh-2, a contact-driven framework for dexterous interaction with articulated objects that extends articulated interaction from object-centric generation to hand-driven dexterous hand--object interaction, where articulated motion must arise through physical contact. We further propose PICA, a physically informed contact-aware training mechanism that injects physical signals into policy learning without tactile or force feedback, improving robustness and task success under changing contact loads. Finally, we conduct systematic evaluation across multiple damping conditions and articulated-object categories to study robustness under contact-load variation, and provide a pure-geometry dexterous interaction resource to support future loco-manipulation and humanoid hand--object interaction research. Across seven GAPartNet objects, DragMesh-2 achieves stronger robustness under contact-load variation than the compared methods while maintaining high task success across damping conditions.

灵巧操作物理模拟机器人抓取接触建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。