提出3D聚焦匹配网络,实现多实例点云配准的高精度定位与配对。
3D Focusing-and-Matching Network for Multi-Instance Point Cloud Registration
- 通过注意力机制聚焦物体中心,生成候选实例位置。
- 双掩码匹配模块实现模型与各实例间的精确点对点对应。
- 在Scan2CAD和ROBI数据集上达到当前最优效果,适合3D场景理解任务。
多实例点云配准旨在估计场景中模型点云所有实例的位姿。现有方法通常先获取全局对应关系,再聚类得到各实例位姿,但在杂乱和遮挡严重的场景中难以获得准确对应。为此,本文提出一种简单而强大的3D聚焦与匹配网络(3DFMNet),通过学习多对多点云配准来解决该问题。首先设计3D多目标聚焦模块,利用自注意力与交叉注意力关联模型点云与结构相似物体,回归物体中心以生成实例候选。随后提出3D双掩码实例匹配模块,通过实例掩码和重叠掩码精确预测点对点对应关系。在两个公开基准数据集Scan2CAD和ROBI上的大量实验表明,本方法在多实例点云配准任务中达到新的最先进性能。代码已开源:https://github.com/zlynpu/3DFMNet。
原文摘要 · Abstract (English)
Multi-instance point cloud registration aims to estimate the pose of all instances of a model point cloud in the whole scene. Existing methods all adopt the strategy of first obtaining the global correspondence and then clustering to obtain the pose of each instance. However, due to the cluttered and occluded objects in the scene, it is difficult to obtain an accurate correspondence between the model point cloud and all instances in the scene. To this end, we propose a simple yet powerful 3D focusing-and-matching network for multi-instance point cloud registration by learning the multiple pair-wise point cloud registration. Specifically, we first present a 3D multi-object focusing module to locate the center of each object and generate object proposals. By using self-attention and cross-attention to associate the model point cloud with structurally similar objects, we can locate potential matching instances by regressing object centers. Then, we propose a 3D dual masking instance matching module to estimate the pose between the model point cloud and each object proposal. It performs instance mask and overlap mask masks to accurately predict the pair-wise correspondence. Extensive experiments on two public benchmarks, Scan2CAD and ROBI, show that our method achieves a new state-of-the-art performance on the multi-instance point cloud registration task. Code is available at https://github.com/zlynpu/3DFMNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。