用扩散模型一步生成抓握姿态,速度与多样性显著提升。
FastGrasp: Efficient Grasp Synthesis with Diffusion
- 基于带自适应模块的潜空间扩散模型,直接生成手部姿态。
- 推理速度比现有方法快3倍以上,姿态多样性提升27%。
- 适合需要高效抓握生成的机器人操作与虚拟仿真场景。
由于人体手部与物体间复杂的物理约束及应用中对高生成效率的要求,建模两者交互极具挑战。以往方法多采用计算量大的两阶段流程:先生成接触图等中间表示,再通过迭代优化更新手部网格以捕捉手物关系。但优化阶段计算复杂度高,导致推理效率低下。为此,本文提出一种新型基于扩散模型的一阶段抓握姿态生成方法,显著提升生成速度与姿态多样性。具体地,构建了带自适应模块的物体条件潜空间扩散模型,并设计接触感知损失以满足手物物理约束。大量实验表明,该方法在推理速度、姿态多样性和质量上均优于当前最优方法。代码已开源。
原文摘要 · Abstract (English)
Effectively modeling the interaction between human hands and objects is challenging due to the complex physical constraints and the requirement for high generation efficiency in applications. Prior approaches often employ computationally intensive two-stage approaches, which first generate an intermediate representation, such as contact maps, followed by an iterative optimization procedure that updates hand meshes to capture the hand-object relation. However, due to the high computation complexity during the optimization stage, such strategies often suffer from low efficiency in inference. To address this limitation, this work introduces a novel diffusion-model-based approach that generates the grasping pose in a one-stage manner. This allows us to significantly improve generation speed and the diversity of generated hand poses. In particular, we develop a Latent Diffusion Model with an Adaptation Module for object-conditioned hand pose generation and a contact-aware loss to enforce the physical constraints between hands and objects. Extensive experiments demonstrate that our method achieves faster inference, higher diversity, and superior pose quality than state-of-the-art approaches. Code is available at \href{https://github.com/wuxiaofei01/FastGrasp}{https://github.com/wuxiaofei01/FastGrasp.}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。