用谱域扩散模型学习通用形状匹配先验,无需人工设计正则化。
DiffuMatch: Category-Agnostic Spectral Diffusion Priors for Robust Non-rigid Shape Matching
- 基于谱域得分生成模型,数据驱动学习功能映射先验。
- 零样本匹配效果超越传统基于拉普拉斯算子的正则化方法。
- 模型跨类别通用,适用于多种非刚性形状匹配任务。
深度功能映射近年来成为解决非刚性形状对应问题的强大工具。现有方法通常仅将学习能力用于特征函数,仍依赖公理化建模来定义训练损失或网络内的功能映射正则化,限制了其在假设不成立场景下的准确性和适用性。本文首次证明,网络内正则化与功能映射训练均可完全由数据驱动替代。我们首先利用大量高质量映射,通过基于得分的生成模型在谱域训练功能映射生成器;随后,利用该模型在新形状集合上促进真实映射的结构特性。值得注意的是,所学模型具备类别无关性,可完全取代常见的拉普拉斯交换性或映射正交性约束。核心技术贡献是谱域扩散模型的新型蒸馏策略。实验表明,该学习正则化在零样本非刚性形状匹配中优于传统公理方法。
原文摘要 · Abstract (English)
Deep functional maps have recently emerged as a powerful tool for solving non-rigid shape correspondence tasks. Methods that use this approach combine the power and flexibility of the functional map framework, with data-driven learning for improved accuracy and generality. However, most existing methods in this area restrict the learning aspect only to the feature functions and still rely on axiomatic modeling for formulating the training loss or for functional map regularization inside the networks. This limits both the accuracy and the applicability of the resulting approaches only to scenarios where assumptions of the axiomatic models hold. In this work, we show, for the first time, that both in-network regularization and functional map training can be replaced with data-driven methods. For this, we first train a generative model of functional maps in the spectral domain using score-based generative modeling, built from a large collection of high-quality maps. We then exploit the resulting model to promote the structural properties of ground truth functional maps on new shape collections. Remarkably, we demonstrate that the learned models are category-agnostic, and can fully replace commonly used strategies such as enforcing Laplacian commutativity or orthogonality of functional maps. Our key technical contribution is a novel distillation strategy from diffusion models in the spectral domain. Experiments demonstrate that our learned regularization leads to better results than axiomatic approaches for zero-shot non-rigid shape matching. Our code is available at: https://github.com/daidedou/diffumatch/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。