无需真实标签,自动对齐激光与摄影点云。
LPRnet: A self-supervised registration network for LiDAR and photogrammetric point clouds
- 用掩码自编码器在无监督下提取异源点云特征。
- 多尺度掩码训练+旋转平移嵌入,提升配准精度。
- 适合大场景点云融合,尤其缺乏真值时。
LiDAR与摄影测量是主动与被动遥感获取点云的两种技术,各具优势但存在密度、精度、噪声和重叠度等显著差异。由于传感机制、空间分布及坐标系的根本不同,二者点云异质性高,且大规模场景缺乏真实标注,导致融合困难。本文提出一种基于掩码自编码器的自监督注册网络(LPRnet),核心采用多尺度掩码训练策略,在无监督条件下提取鲁棒特征。设计旋转-平移嵌入模块以捕捉刚性变换关键特征,结合基于Transformer的架构,有效融合局部与全局信息,实现精准对齐。实验在两个真实数据集上验证了方法在异源点云注册中的有效性,具备强大的跨模态特征提取能力,解决了场景级真实标签缺失的难题。
原文摘要 · Abstract (English)
LiDAR and photogrammetry are active and passive remote sensing techniques for point cloud acquisition, respectively, offering complementary advantages and heterogeneous. Due to the fundamental differences in sensing mechanisms, spatial distributions and coordinate systems, their point clouds exhibit significant discrepancies in density, precision, noise, and overlap. Coupled with the lack of ground truth for large-scale scenes, integrating the heterogeneous point clouds is a highly challenging task. This paper proposes a self-supervised registration network based on a masked autoencoder, focusing on heterogeneous LiDAR and photogrammetric point clouds. At its core, the method introduces a multi-scale masked training strategy to extract robust features from heterogeneous point clouds under self-supervision. To further enhance registration performance, a rotation-translation embedding module is designed to effectively capture the key features essential for accurate rigid transformations. Building upon the robust representations, a transformer-based architecture seamlessly integrates local and global features, fostering precise alignment across diverse point cloud datasets. The proposed method demonstrates strong feature extraction capabilities for both LiDAR and photogrammetric point clouds, addressing the challenges of acquiring ground truth at the scene level. Experiments conducted on two real-world datasets validate the effectiveness of the proposed method in solving heterogeneous point cloud registration problems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。