用Mamba架构提升点云上采样质量与速度,有效减少表面噪声。
MBPU: A Plug-and-Play State Space Model for Point Cloud Upsamping with Fast Point Rendering
- 基于Mamba的可插拔架构,擅长处理长序列点云数据。
- 在大规模点云上采样中优于现有方法,收敛速度快且无收缩伪影。
- 支持任意尺度上采样,适合高精度3D重建与自动驾驶场景。
点云上采样(PCU)旨在从激光雷达等设备捕获的稀疏输入中生成密集均匀的点云,具有广泛的应用前景但仍是挑战性任务。现有深度学习方法虽取得显著进展,但在处理长序列和消除表面收缩伪影方面仍存在局限。受新提出的Mamba启发,本文提出MBPU,基于Mamba架构构建,擅长长序列建模,尤其适用于大规模点云上采样,并实现快速收敛。此外,MBPU为任意尺度上采样框架,其点精修阶段通过预测点间距离实现自适应调整;同时回归3D位置偏移与1D点距,以约束全局特征并保证局部细节精度。我们还引入快速可微渲染器,进一步提升上采样点云保真度、降低伪影。实验表明,得益于快速点渲染,MBPU能有效消除表面噪声,生成高质量点云,在多项指标上超越现有方法,尤其在大规模点云场景下优势明显。
原文摘要 · Abstract (English)
The task of point cloud upsampling (PCU) is to generate dense and uniform point clouds from sparse input captured by 3D sensors like LiDAR, holding potential applications in real yet is still a challenging task. Existing deep learning-based methods have shown significant achievements in this field. However, they still face limitations in effectively handling long sequences and addressing the issue of shrinkage artifacts around the surface of the point cloud. Inspired by the newly proposed Mamba, in this paper, we introduce a network named MBPU built on top of the Mamba architecture, which performs well in long sequence modeling, especially for large-scale point cloud upsampling, and achieves fast convergence speed. Moreover, MBPU is an arbitrary-scale upsampling framework as the predictor of point distance in the point refinement phase. At the same time, we simultaneously predict the 3D position shift and 1D point-to-point distance as regression quantities to constrain the global features while ensuring the accuracy of local details. We also introduce a fast differentiable renderer to further enhance the fidelity of the upsampled point cloud and reduce artifacts. It is noted that, by the merits of our fast point rendering, MBPU yields high-quality upsampled point clouds by effectively eliminating surface noise. Extensive experiments have demonstrated that our MBPU outperforms other off-the-shelf methods in terms of point cloud upsampling, especially for large-scale point clouds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。