arXiv:2503.18671cs.CV2025-03CVPR被引 2

不依赖特征匹配,通过结构感知学习实现精准相对位姿估计

Structure-Aware Correspondence Learning for Relative Pose Estimation

  • 基于结构感知的关键点提取,捕捉不同物体的形状特征
  • 通过关键点间关系建模,提升对不可见区域的对应关系估计
  • 在多个数据集上显著优于现有方法,尤其在低重叠场景表现突出

相对位姿估计为实现无对象依赖的姿态估计提供了新思路。尽管现有基于3D对应的方法已取得进展,但其依赖显式特征匹配,在可见区域重叠较小时效果不佳,且对不可见区域的特征估计不可靠。受人类通过考虑物体结构来拼合部分重叠或无重叠区域的启发,本文提出一种结构感知对应学习方法,包含两个核心模块:首先,设计结构感知关键点提取模块,通过基于关键点的图像重建损失引导,定位能表征不同形状与外观物体结构的一组关键点;其次,设计结构感知对应估计模块,建模关键点间的图像内与图像间关系,提取用于对应估计的结构感知特征。通过联合使用这两个模块,所提方法可自然地在无需显式特征匹配的情况下估计3D-3D对应关系,实现对未见物体的精确相对位姿估计。在CO3D、Objaverse和LineMOD数据集上的实验结果表明,该方法显著优于先前方法,在CO3D数据集上均角误差降低5.7°。

原文摘要 · Abstract (English)

Relative pose estimation provides a promising way for achieving object-agnostic pose estimation. Despite the success of existing 3D correspondence-based methods, the reliance on explicit feature matching suffers from small overlaps in visible regions and unreliable feature estimation for invisible regions. Inspired by humans' ability to assemble two object parts that have small or no overlapping regions by considering object structure, we propose a novel Structure-Aware Correspondence Learning method for Relative Pose Estimation, which consists of two key modules. First, a structure-aware keypoint extraction module is designed to locate a set of kepoints that can represent the structure of objects with different shapes and appearance, under the guidance of a keypoint based image reconstruction loss. Second, a structure-aware correspondence estimation module is designed to model the intra-image and inter-image relationships between keypoints to extract structure-aware features for correspondence estimation. By jointly leveraging these two modules, the proposed method can naturally estimate 3D-3D correspondences for unseen objects without explicit feature matching for precise relative pose estimation. Experimental results on the CO3D, Objaverse and LineMOD datasets demonstrate that the proposed method significantly outperforms prior methods, i.e., with 5.7°reduction in mean angular error on the CO3D dataset.

位姿估计结构感知对应学习3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。