用扩散模型直接预测形状对应关系,无需特定类别训练数据。
Denoising Functional Maps: Diffusion Models for Shape Correspondence
- 基于扩散模型直接学习形状间的功能映射表示。
- 在标准人体数据集上表现优于现有方法,适用于非等距变形形状。
- 无需类别特定数据,适合跨类形变形状的通用对应任务。
估计可变形形状对之间的对应关系仍是挑战性问题。尽管已有显著进展,现有方法普遍存在泛化能力不足且需类别特定训练数据的问题。为此,我们提出一种基于去噪扩散模型的全新形状对应方法。该方法让扩散模型直接预测功能映射——即形状间点对点映射的低维表示。我们使用大规模合成人体网格数据集进行训练,并通过两步减少需学习的功能映射数量:首先,映射参考一个模板而非成对形状;其次,功能映射定义在拉普拉斯算子特征向量基上,因符号歧义导致基不唯一。因此,我们提出一种无监督方法,基于表面特征修正特征向量符号以确定特定基。模型在标准人体数据集、各向异性连接网格、非等距人形形状以及动物形状上均取得与现有描述符方法和大规模形变方法相当的性能。
原文摘要 · Abstract (English)
Estimating correspondences between pairs of deformable shapes remains a challenging problem. Despite substantial progress, existing methods lack broad generalization capabilities and require category-specific training data. To address these limitations, we propose a fundamentally new approach to shape correspondence based on denoising diffusion models. In our method, a diffusion model learns to directly predict the functional map, a low-dimensional representation of a point-wise map between shapes. We use a large dataset of synthetic human meshes for training and employ two steps to reduce the number of functional maps that need to be learned. First, the maps refer to a template rather than shape pairs. Second, the functional map is defined in a basis of eigenvectors of the Laplacian, which is not unique due to sign ambiguity. Therefore, we introduce an unsupervised approach to select a specific basis by correcting the signs of eigenvectors based on surface features. Our model achieves competitive performance on standard human datasets, meshes with anisotropic connectivity, non-isometric humanoid shapes, as well as animals compared to existing descriptor-based and large-scale shape deformation methods. See our project page for the source code and the datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。