R3PM-Net实现高精度实时点云匹配,适合工业现场复杂场景。
R3PM-Net: Real-time, Robust, Real-world Point Matching Network

- 基于全局感知的轻量级网络,专注真实世界点云匹配
- 在ModelNet40上0.007秒完成匹配,精度达0.029厘米
- 支持工业级弱结构数据,50毫秒内处理挑战性扫描
点云配准是3D数据处理的关键任务,旨在估计两组点云间的刚性变换。尽管深度学习方法克服了传统方法对噪声、离群点、遮挡和初值敏感的问题,但其训练与评估多基于干净、稠密的合成数据集,难以泛化到真实工业场景。本文提出R3PM-Net,一种轻量级、全局感知、面向物体级别的点匹配网络,旨在提升模型在真实世界的通用性与实时效率。为此,构建了两个新数据集Sioux-Cranfield和Sioux-Scans,用于将不完美摄影测量与事件相机扫描与数字CAD模型配准,并已公开。大量实验表明,R3PM-Net在保持极高精度的同时具备卓越速度:在ModelNet40上仅需0.007秒即达到1.0的拟合度与0.029厘米的内点均方根误差,约比当前最优方法RegTR快7倍;在Sioux-Cranfield上维持1.0拟合度与0.030厘米误差;在极具挑战的Sioux-Scans数据集上亦能在50毫秒内解决边缘案例。结果验证了该方法在精度与实时性兼具的工业应用中的鲁棒性。代码与数据集已开源。
原文摘要 · Abstract (English)
Accurate Point Cloud Registration (PCR) is an important task in 3D data processing, involving the estimation of a rigid transformation between two point clouds. While deep-learning methods have addressed key limitations of traditional non-learning approaches, such as sensitivity to noise, outliers, occlusion, and initialization, they are developed and evaluated on clean, dense, synthetic datasets (limiting their generalizability to real-world industrial scenarios). This paper introduces R3PM-Net, a lightweight, global-aware, object-level point matching network designed to bridge this gap by prioritizing both generalizability and real-time efficiency. To support this transition, two datasets, Sioux-Cranfield and Sioux-Scans, are proposed. They provide an evaluation ground for registering imperfect photogrammetric and event-camera scans to digital CAD models, and have been made publicly available. Extensive experiments demonstrate that R3PM-Net achieves competitive accuracy with unmatched speed. On ModelNet40, it reaches a perfect fitness score of $1$ and inlier RMSE of $0.029$ cm in only $0.007$s, approximately 7 times faster than the state-of-the-art method RegTR. This performance carries over to the Sioux-Cranfield dataset, maintaining a fitness of $1$ and inlier RMSE of $0.030$ cm with similarly low latency. Furthermore, on the highly challenging Sioux-Scans dataset, R3PM-Net successfully resolves edge cases in under 50 ms. These results confirm that R3PM-Net offers a robust, high-speed solution for critical industrial applications, where precision and real-time performance are indispensable. The code and datasets are available at https://github.com/YasiiKB/R3PM-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。