arXiv:2505.02501cs.CVcs.AI2025-05被引 5

利用视觉模糊对应关系,精准预测6D位姿分布

Corr2Distrib: Making Ambiguous Correspondences an Ally to Predict Reliable 6D Pose Distributions

  • 基于3D点对称性学习描述符与局部坐标系,生成旋转假设
  • 在复杂真实场景中,位姿分布估计和单个位姿估计均优于现有方法
  • 适合需要鲁棒位姿推理的工业检测与机器人抓取场景

我们提出Corr2Distrib,首个基于对应关系的6D相机位姿分布估计方法,可解释观测结果。对称性和遮挡导致视觉模糊,引发多个有效位姿。尽管近期已有研究尝试解决该问题,但未依赖局部对应关系——根据BOP挑战赛标准,这是当前最有效的单个6DoF位姿估计方式。直接使用对应关系估计位姿分布面临挑战,因模糊对应会显著降低PnP性能。Corr2Distrib将这些模糊性转化为优势,恢复所有有效位姿。首先,为物体表面每个3D点学习对称性感知表示(含描述符与局部帧),从而从单个2D-3D对应生成3DoF旋转假设;随后通过PnP与位姿评分精炼为6DoF位姿分布。在复杂非合成场景的实验表明,Corr2Distrib在位姿分布估计和单个位姿估计上均超越现有最优方法,证明了基于对应关系方法的潜力。

原文摘要 · Abstract (English)

We introduce Corr2Distrib, the first correspondence-based method which estimates a 6D camera pose distribution from an RGB image, explaining the observations. Indeed, symmetries and occlusions introduce visual ambiguities, leading to multiple valid poses. While a few recent methods tackle this problem, they do not rely on local correspondences which, according to the BOP Challenge, are currently the most effective way to estimate a single 6DoF pose solution. Using correspondences to estimate a pose distribution is not straightforward, since ambiguous correspondences induced by visual ambiguities drastically decrease the performance of PnP. With Corr2Distrib, we turn these ambiguities into an advantage to recover all valid poses. Corr2Distrib first learns a symmetry-aware representation for each 3D point on the object's surface, characterized by a descriptor and a local frame. This representation enables the generation of 3DoF rotation hypotheses from single 2D-3D correspondences. Next, we refine these hypotheses into a 6DoF pose distribution using PnP and pose scoring. Our experimental evaluations on complex non-synthetic scenes show that Corr2Distrib outperforms state-of-the-art solutions for both pose distribution estimation and single pose estimation from an RGB image, demonstrating the potential of correspondences-based approaches.

6D位姿估计对应关系位姿分布

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。