arXiv:2604.16680cs.CV2026-04

无需训练的3D点云配准,用生成图像提升跨域鲁棒性

C-GenReg: Training-Free 3D Point Cloud Registration by Multi-View-Consistent Geometry-to-Image Generation with Probabilistic Modalities Fusion

论文配图:C-GenReg: Training-Free 3D Point Cloud Registration by Multi-View-Consistent Geometry-to-Image Generation with Probabilistic Modalities Fusion
图 1 · 摘自论文原文
  • 将点云转为多视角一致的图像,利用预训练视觉模型匹配
  • 在真实室外激光雷达数据上实现零样本配准,准确率超基线
  • 融合生成图像与原始几何信息,无需微调且置信度可校准

我们提出C-GenReg,一种无需训练的3D点云配准框架,融合世界规模生成先验与面向配准的视觉基础模型(VFMs)的优势。现有学习型方法在不同传感器模态、采样差异和环境间泛化能力差。C-GenReg通过世界基础模型将输入几何信息合成多视图一致的RGB表示,将匹配问题转移至视觉模型擅长的图像域。生成视图保持源与目标视角的空间一致性,无需微调。基于预训练于密集对应关系的VFM提取像素匹配,并通过原始深度图映射回3D空间。为进一步增强鲁棒性,引入“匹配-融合”概率冷融合策略,结合生成图像分支与原始几何分支的独立对应后验分布,保留各模态归纳偏置并提供校准置信度,无需额外学习。该方法为零样本、即插即用,所有模块均预训练完成。在室内(3DMatch、ScanNet)和室外(Waymo)基准上广泛实验表明,其具备强零样本性能与卓越跨域泛化能力。首次在无影像数据的真实室外激光雷达数据上成功实现生成式配准。

原文摘要 · Abstract (English)

We introduce C-GenReg, a training-free framework for 3D point cloud registration that leverages the complementary strengths of world-scale generative priors and registration-oriented Vision Foundation Models (VFMs). Current learning-based 3D point cloud registration methods struggle to generalize across sensing modalities, sampling differences, and environments. Hence, C-GenReg augments the geometric point cloud registration branch by transferring the matching problem into an auxiliary image domain, where VFMs excel, using a World Foundation Model to synthesize multi-view-consistent RGB representations from the input geometry. This generative transfer, preserves spatial coherence across source and target views without any fine-tuning. From these generated views, a VFM pretrained for finding dense correspondences extracts matches. The resulting pixel correspondences are lifted back to 3D via the original depth maps. To further enhance robustness, we introduce a "Match-then-Fuse" probabilistic cold-fusion scheme that combines two independent correspondence posteriors, that of the generated-RGB branch with that of the raw geometric branch. This principled fusion preserves each modality inductive bias and provides calibrated confidence without any additional learning. C-GenReg is zero-shot and plug-and-play: all modules are pretrained and operate without fine-tuning. Extensive experiments on indoor (3DMatch, ScanNet) and outdoor (Waymo) benchmarks demonstrate strong zero-shot performance and superior cross-domain generalization. For the first time, we demonstrate a generative registration framework that operates successfully on real outdoor LiDAR data, where no imagery data is available.

3D配准生成模型零样本多模态融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。