用神经特征指导非刚性三维形状配准,无需标注对应点。
NFR: Neural Feature-Guided Non-Rigid Shape Registration
- 将深度学习的神经特征融入迭代几何配准流程
- 仅需数十个训练样本即达顶尖性能,应对大变形与不完整形状
- 适合处理复杂形变下的新形状配准,传统方法失效场景也有效
本文提出一种基于学习的3D形状配准新框架,克服输入形状间显著的非刚性形变与部分缺失问题,且训练时无需对应点标注。核心思想是将深度学习形状匹配网络学习的神经特征融入迭代几何配准流程。神经特征相比空间坐标提供更准确、语义更丰富的对应关系,对大非刚性形变至关重要;同时,对应关系根据中间配准结果动态更新,并通过一致性先验过滤,显著提升整体鲁棒性。实验证明,仅需几十个变异性有限的训练形状,本方法在多个非刚性点云匹配和部分形状匹配基准上达到当前最优,且能生成未见过的、经历显著外在与内在形变的形状对的高质量对应关系,传统方法与内在方法均失效的场景下依然有效。代码已开源。
原文摘要 · Abstract (English)
In this paper, we propose a novel learning-based framework for 3D shape registration, which overcomes the challenges of significant non-rigid deformation and partiality undergoing among input shapes, and, remarkably, requires no correspondence annotation during training. Our key insight is to incorporate neural features learned by deep learning-based shape matching networks into an iterative, geometric shape registration pipeline. The advantage of our approach is two-fold -- On one hand, neural features provide more accurate and semantically meaningful correspondence estimation than spatial features (e.g., coordinates), which is critical in the presence of large non-rigid deformations; On the other hand, the correspondences are dynamically updated according to the intermediate registrations and filtered by consistency prior, which prominently robustify the overall pipeline. Empirical results show that, with as few as dozens of training shapes of limited variability, our pipeline achieves state-of-the-art results on several benchmarks of non-rigid point cloud matching and partial shape matching across varying settings, but also delivers high-quality correspondences between unseen challenging shape pairs that undergo both significant extrinsic and intrinsic deformations, in which case neither traditional registration methods nor intrinsic methods work. Our code is available at https://github.com/rqhuang88/NFR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。