arXiv:2607.17200cs.CV2026-07

通过跨坐标裁剪提升图像到点云配准精度,解决点云密度难题。

Cross-Coordinate Correspondence Pruning for Image-to-Point Cloud Registration

论文配图:Cross-Coordinate Correspondence Pruning for Image-to-Point Cloud Registration
图 1 · 摘自论文原文
  • 将跨模态对应关系投影至图像坐标系统一空间,减少坐标差异干扰。
  • 设计轻量裁剪网络,从几何与特征维度预测置信度,过滤粗匹配中的误匹配。
  • 多密度点云集成策略提升内点召回率,显著改善配准效果,适合高精度3D重建场景。

近期无检测方法通过粗到精匹配流程在图像到点云(I2P)配准中表现优异。粗阶段通常将下采样图像特征与体素化点云特征融合,建立初始粗对应关系以供后续优化。然而,现有方法普遍忽视点云密度的关键作用,其直接影响粗对应质量与最终配准结果。过稀疏点云导致内点不足,过密集则引入高比例外点,形成固有的密度权衡,严重限制当前方法的配准精度。为此,我们提出一种新型跨坐标对应裁剪(CCP)策略,在保证足够内点的同时维持低外点率。为减少跨模态坐标差异干扰,先将跨坐标粗对应投影至二维图像坐标系进行空间统一;随后,轻量级裁剪网络从几何结构和模态特征维度预测内点置信度,用于过滤粗外点。为进一步提升内点召回率,设计多密度点云集成(MDPE)策略,整合并去重不同密度下的裁剪后粗对应。该方法在多个基准测试中注册召回率较现有最先进方法提升至少8.6%。

原文摘要 · Abstract (English)

Recent detection-free approaches have shown significant efficacy in image-to-point cloud (I2P) registration by employing a coarse-to-fine matching pipeline. In the coarse stage, down-sampled image features and voxelized point cloud features are typically fused to establish initial coarse correspondences for subsequent refinement. However, existing methods largely overlook the critical role of point cloud density, which fundamentally dictates the quality of coarse correspondences and the final registration results. Specifically, excessively sparse point clouds lead to an insufficient number of inliers, while overly dense ones often introduce a high outlier ratio. Consequently, this creates an inherent density trade-off, thereby significantly limiting the registration accuracy of current approaches. For mitigating this trade-off, we propose a novel Cross-Coordinate Correspondences Pruning (CCP) strategy to acquire sufficient inliers while ensuring a low outlier ratio. To minimize interference from inter-modal coordinate discrepancies, we first project cross-coordinate coarse correspondences to the 2D image coordinate system for spatial unification. Subsequently, a lightweight pruning network is responsible for predicting the inlier confidences, which are used to filter coarse outliers, from coordinate geometric and modal feature dimensions. To maximize inlier recall, we further design a Multi-Density Point Ensemble (MDPE) strategy that consolidates and deduplicates pruned coarse correspondences across varying point cloud densities. Our method achieves a significant performance improvement, surpassing existing state-of-the-art methods by at least 8.6% in Registration Recall across various benchmarks.

点云配准图像-点云坐标对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。