用扩散模型实现无监督的激光雷达点云场景级超分辨率
PVNet: Point-Voxel Interaction LiDAR Scene Upsampling Via Diffusion Models
- 基于扩散模型,通过点与体素交互生成稀疏点云的高精度补全
- 在多个基准上达到当前最佳性能,支持任意放大倍率
- 适合自动驾驶、机器人等复杂室外环境感知任务
户外环境中的精准3D场景理解高度依赖高质量点云,但激光雷达扫描数据常因极端稀疏而影响下游感知任务。现有方法多聚焦单个物体,难以泛化至复杂室外场景。为此,我们提出PVNet,一种基于扩散模型的点-体素交互框架,实现无需密集监督的点云超分辨率。具体地,采用无分类器引导的DDPMs进行生成,以稀疏点云为引导条件,邻近帧合成点云作为输入;设计体素补全模块以丰富特征表示;提出点-体素交互模块融合点与体素特征,显著提升每个上采样点的环境感知能力。据我们所知,该方法是首个支持任意上采样率的场景级点云超分辨率方法。在多个基准上的大量实验表明,本方法性能领先。代码将开源于https://github.com/chengxianjing/PVNet。
原文摘要 · Abstract (English)
Accurate 3D scene understanding in outdoor environments heavily relies on high-quality point clouds. However, LiDAR-scanned data often suffer from extreme sparsity, severely hindering downstream 3D perception tasks. Existing point cloud upsampling methods primarily focus on individual objects, thus demonstrating limited generalization capability for complex outdoor scenes. To address this issue, we propose PVNet, a diffusion model-based point-voxel interaction framework to perform LiDAR point cloud upsampling without dense supervision. Specifically, we adopt the classifier-free guidance-based DDPMs to guide the generation, in which we employ a sparse point cloud as the guiding condition and the synthesized point clouds derived from its nearby frames as the input. Moreover, we design a voxel completion module to refine and complete the coarse voxel features for enriching the feature representation. In addition, we propose a point-voxel interaction module to integrate features from both points and voxels, which efficiently improves the environmental perception capability of each upsampled point. To the best of our knowledge, our approach is the first scene-level point cloud upsampling method supporting arbitrary upsampling rates. Extensive experiments on various benchmarks demonstrate that our method achieves state-of-the-art performance. The source code will be available at https://github.com/chengxianjing/PVNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。