arXiv:2501.15839cs.CV2025-01被引 1

用2D信息生成可控制的手部抓握,提升精度与评估效率

Controllable Hand Grasp Generation for HOI and Efficient Evaluation Methods

  • 将手部姿态建模为图结构,利用高阶几何关系增强生成质量
  • 基于2D图像的扩散方法在抓握生成上超越现有最优模型
  • 提出新评估框架,解决传统指标偏差与低效问题

可控的物手交互(HOI)生成在计算机视觉中日益重要。手部抓握生成是有效控制手部几何的关键步骤。现有方法依赖于手与物体的3D信息,且难以控制手的位置和朝向。本文将手部姿态视为离散图结构,利用几何先验,借鉴谱图理论与向量代数,提出高阶几何表示(HOR's),以提升生成手姿的质量。基于此,我们设计了一种仅使用2D信息的可控扩散方法,其性能优于当前最先进水平(SOTA)。同时,针对现有评估指标(如FID、MMD)存在偏差与效率低的问题,我们利用HOR's构建了高效稳定的抓握生成评估框架,显著改善了评估可靠性。

原文摘要 · Abstract (English)

Controllable affordance Hand-Object Interaction (HOI) generation has become an increasingly important area of research in computer vision. In HOI generation, the hand grasp generation is a crucial step for effectively controlling the geometry of the hand. Current hand grasp generation methods rely on 3D information for both the hand and the object. In addition, these methods lack controllability concerning the hand's location and orientation. We treat the hand pose as the discrete graph structure and exploit the geometric priors. It is well established that higher order contextual dependency among the points improves the quality of the results in general. We propose a framework of higher order geometric representations (HOR's) inspired by spectral graph theory and vector algebra to improve the quality of generated hand poses. We demonstrate the effectiveness of our proposed HOR's in devising a controllable novel diffusion method (based on 2D information) for hand grasp generation that outperforms the state of the art (SOTA). Overcoming the limitations of existing methods: like lacking of controllability and dependency on 3D information. Once we have the generated pose, it is very natural to evaluate them using a metric. Popular metrics like FID and MMD are biased and inefficient for evaluating the generated hand poses. Using our proposed HOR's, we introduce an efficient and stable framework of evaluation metrics for grasp generation methods, addressing inefficiencies and biases in FID and MMD.

手部生成扩散模型评估方法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。