用关系感知+渐进式特征提取,提升点云补全的全局结构与局部细节精度
PointCFormer: a Relation-based Progressive Feature Extraction Network for Point Cloud Completion
- 基于点间关系度量,精准捕捉局部几何特征
- 渐进式设计在保持全局结构的同时细化局部细节
- 适合需要高精度点云重建的3D视觉任务
点云补全是从不完整点云重建完整3D形状的关键任务,对3D目标检测和分割至关重要。现有方法受限于点云稀疏采样导致的全局结构丢失,以及传统局部特征提取难以捕捉复杂几何细节。为此,我们提出PointCFormer,一种专为点云补全优化的Transformer框架。首先,设计基于关系的局部特征提取方法,通过建立目标点与其k近邻间的细粒度关系度量,量化各邻居对目标点局部特征的贡献。其次,引入渐进式特征提取器,结合局部感知与自注意力机制,从密集采样输入开始,逐步查询远距离全局依赖与局部邻域关系,增强全局结构并保留精细局部细节,且计算开销小。此外,在潜在空间生成点代理后,设计修正模块,将输入点的稠密信息重新引入,提升点代理的表征能力。PointCFormer在多个主流基准上达到当前最优性能。代码已开源。
原文摘要 · Abstract (English)
Point cloud completion aims to reconstruct the complete 3D shape from incomplete point clouds, and it is crucial for tasks such as 3D object detection and segmentation. Despite the continuous advances in point cloud analysis techniques, feature extraction methods are still confronted with apparent limitations. The sparse sampling of point clouds, used as inputs in most methods, often results in a certain loss of global structure information. Meanwhile, traditional local feature extraction methods usually struggle to capture the intricate geometric details. To overcome these drawbacks, we introduce PointCFormer, a transformer framework optimized for robust global retention and precise local detail capture in point cloud completion. This framework embraces several key advantages. First, we propose a relation-based local feature extraction method to perceive local delicate geometry characteristics. This approach establishes a fine-grained relationship metric between the target point and its k-nearest neighbors, quantifying each neighboring point's contribution to the target point's local features. Secondly, we introduce a progressive feature extractor that integrates our local feature perception method with self-attention. Starting with a denser sampling of points as input, it iteratively queries long-distance global dependencies and local neighborhood relationships. This extractor maintains enhanced global structure and refined local details, without generating substantial computational overhead. Additionally, we develop a correction module after generating point proxies in the latent space to reintroduce denser information from the input points, enhancing the representation capability of the point proxies. PointCFormer demonstrates state-of-the-art performance on several widely used benchmarks. Our code is available at https://github.com/Zyyyyy0926/PointCFormer_Plus_Pytorch.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。