通过特征几何一致性挖掘,实现无需标注的点云配准。
Mining and Transferring Feature-Geometry Coherence for Unsupervised Point Cloud Registration
- 动态教师机制结合特征与几何信息挖掘可靠伪标签。
- 在KITTI和nuScenes上达到领先精度,对密度变化鲁棒。
- 适合自动驾驶等户外场景的点云配准任务。
点云配准是3D视觉的基础任务,基于学习的方法在室外环境中取得了显著进展。无监督室外点云配准方法近年来出现,以避免昂贵的姿态标注需求。然而,这些方法难以建立可靠的无监督优化目标,要么依赖过强的几何假设,要么因低层几何与高层上下文信息整合不足而产生劣质伪标签。我们观察到,在特征空间中,新的内点对应关系倾向于围绕总结现有内点特征的正锚点聚集。受此启发,我们提出一种新型无监督配准方法INTEGER,通过引入高层上下文信息实现可靠的伪标签挖掘。具体地,我们设计了特征-几何一致性挖掘模块,动态适应每批次数据的教师网络,并结合高层特征表示与低层几何线索发现可靠伪标签。此外,提出基于锚点的对比学习,增强特征空间的判别性。最后,引入混合密度学生网络,学习密度不变特征,解决室外场景中密度变化和重叠度低的问题。在KITTI和nuScenes数据集上的大量实验表明,INTEGER在准确性和泛化能力方面均表现优异。
原文摘要 · Abstract (English)
Point cloud registration, a fundamental task in 3D vision, has achieved remarkable success with learning-based methods in outdoor environments. Unsupervised outdoor point cloud registration methods have recently emerged to circumvent the need for costly pose annotations. However, they fail to establish reliable optimization objectives for unsupervised training, either relying on overly strong geometric assumptions, or suffering from poor-quality pseudo-labels due to inadequate integration of low-level geometric and high-level contextual information. We have observed that in the feature space, latent new inlier correspondences tend to cluster around respective positive anchors that summarize features of existing inliers. Motivated by this observation, we propose a novel unsupervised registration method termed INTEGER to incorporate high-level contextual information for reliable pseudo-label mining. Specifically, we propose the Feature-Geometry Coherence Mining module to dynamically adapt the teacher for each mini-batch of data during training and discover reliable pseudo-labels by considering both high-level feature representations and low-level geometric cues. Furthermore, we propose Anchor-Based Contrastive Learning to facilitate contrastive learning with anchors for a robust feature space. Lastly, we introduce a Mixed-Density Student to learn density-invariant features, addressing challenges related to density variation and low overlap in the outdoor scenario. Extensive experiments on KITTI and nuScenes datasets demonstrate that our INTEGER achieves competitive performance in terms of accuracy and generalizability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。