arXiv:2509.03114cs.CV2025-09

用引力场扩散桥模拟手物交互,解决穿插与变形难题

Towards Realistic Hand-Object Interaction with Gravity-Field Based Diffusion Bridge

  • 将手物交互建模为引力驱动过程,生成无穿插的物理合理姿态
  • 在多个数据集上实现稳定抓握,真实捕捉手部形变细节
  • 融合文本语义引导引力场,适合需要语义理解的交互场景

现有手物姿态估计方法虽能生成粗略交互状态,但因手部与物体几何复杂多样,常出现相互穿插或接触区域存在明显空隙的问题。此外,真实手部表面在交互过程中会产生显著形变,传统方法难以准确捕捉与表达。为此,本文将手物交互建模为吸引驱动过程,提出基于引力场的扩散桥(GravityDB)模型,用于模拟可变形手部表面与刚性物体间的交互。该方法有效解决了上述问题,生成无穿插、稳定抓握且真实反映手部形变的交互结果。同时,引入文本描述中的语义信息以指导引力场构建,提升交互区域的语义合理性。在多个数据集上的大量定性和定量实验验证了方法的有效性。

原文摘要 · Abstract (English)

Existing reconstruction or hand-object pose estimation methods are capable of producing coarse interaction states. However, due to the complex and diverse geometry of both human hands and objects, these approaches often suffer from interpenetration or leave noticeable gaps in regions that are supposed to be in contact. Moreover, the surface of a real human hand undergoes non-negligible deformations during interaction, which are difficult to capture and represent with previous methods. To tackle these challenges, we formulate hand-object interaction as an attraction-driven process and propose a Gravity-Field Based Diffusion Bridge (GravityDB) to simulate interactions between a deformable hand surface and rigid objects. Our approach effectively resolves the aforementioned issues by generating physically plausible interactions that are free of interpenetration, ensure stable grasping, and capture realistic hand deformations. Furthermore, we incorporate semantic information from textual descriptions to guide the construction of the gravitational field, enabling more semantically meaningful interaction regions. Extensive qualitative and quantitative experiments on multiple datasets demonstrate the effectiveness of our method.

手物交互扩散模型物理模拟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。