arXiv:2512.09407cs.CV2025-12

用生成图像提升点云配准精度,跨视图一致性强。

Geometry-to-Image Synthesis-Driven Generative Point Cloud Registration

  • 通过可控生成模型合成与点云对齐的图像对
  • 在3DMatch、ScanNet等数据集上显著提升配准准确率
  • 适合做点云配准的算法改进,尤其适用于深度与激光雷达数据

本文提出一种新型3D配准范式——生成式点云配准,将先进的2D生成模型与3D匹配任务结合,以提升配准性能。核心思路是生成与源点云和目标点云高度对齐的跨视图一致图像对,实现几何-颜色特征融合,增强鲁棒匹配。为确保高质量匹配,生成图像需满足2D-3D几何一致性与跨视图纹理一致性。为此,我们提出DepthMatch-ControlNet与LiDARMatch-ControlNet两个专用于匹配的可控2D生成模型。针对基于深度相机的点云(由深度图生成),DepthMatch-ControlNet利用ControlNet的深度条件生成能力,合成与深度图几何一致的透视图RGB图像,实现精确2D-3D对齐;并通过耦合条件去噪与提示引导机制,促进跨视图特征交互,指导纹理一致性生成。针对激光雷达数据,LiDARMatch-ControlNet将360°激光点云投影为等距圆柱形距离图,生成对应的全景RGB图像。该生成式配准框架通用性强,可无缝集成至多种现有配准方法中提升性能。在3DMatch、ScanNet(深度相机设置)以及Dur360BEV(激光雷达设置)数据集上的大量实验验证了其有效性。

原文摘要 · Abstract (English)

In this paper, we propose a novel 3D registration paradigm, Generative Point Cloud Registration, which bridges advanced 2D generative models with 3D matching tasks to enhance registration performance. Our key idea is to generate cross-view consistent image pairs that are well-aligned with the source and target point clouds, enabling geometry-color feature fusion to facilitate robust matching. To ensure high-quality matching, the generated image pair should feature both 2D-3D geometric consistency and cross-view texture consistency. To this end, we introduce DepthMatch-ControlNet and LiDARMatch-ControlNet, two matching-specific, controllable 2D generative models. Specifically, for depth camera-based 3D registration with point clouds derived from the depth maps, DepthMatch-ControlNet leverages the depth-conditioned generation capabilities of ControlNet to synthesize perspective-view RGB images that are geometrically consistent with depth maps, ensuring accurate 2D-3D alignment. Additionally, by incorporating a coupled conditional denoising scheme and coupled prompt guidance, it further promotes cross-view feature interaction, guiding texture consistency generation. To address LiDAR-based 3D registration with point clouds captured by LiDAR sensors, LiDARMatch-ControlNet extends this framework by conditioning on paired equirectangular range maps projected from 360-degree LiDAR point clouds, generating corresponding panoramic RGB images. Our generative 3D registration paradigm is general and can be seamlessly integrated into a wide range of existing registration methods to improve their performance. Extensive experiments on the 3DMatch and ScanNet datasets (for depth-camera settings), as well as the Dur360BEV dataset (for LiDAR settings), demonstrate the effectiveness of our approach.

点云配准生成模型图像生成3D匹配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。