用扩散模型提升点云语义分割精度,兼顾效率与细节
PointDiffuse: A Dual-Conditional Diffusion Model for Enhanced Point Cloud Semantic Segmentation
- 设计双条件扩散模型,用噪声标签嵌入加速反向去噪
- 在S3DIS和SWAN上分别达74.2%、64.8% mIoU,性能领先
- 适合需要高精度点云分割的自动驾驶与三维建模场景
传统扩散模型用于生成二维图像中固定像素位置的颜色。本文将其拓展至点云语义分割任务,其中点位置保持不变,扩散模型生成点标签而非颜色。为加速反向去噪过程,引入噪声标签嵌入机制,将语义信息融入噪声标签,提供初始语义参考以提升反向扩散效率。同时提出点频 Transformer,增强点云中高层上下文调整能力。为降低计算复杂度,将位置条件引入MLP,并提出去噪PointNet,在不丢失几何细节的前提下处理高分辨率点云。最终将上述组件整合为基于双条件扩散模型的PointDiffuse网络,实现大规模点云语义分割。在五个基准数据集上的实验表明,PointDiffuse性能领先,S3DIS Area 5上mIoU达74.2%,S3DIS 6-fold上达81.2%,SWAN数据集上达64.8%。
原文摘要 · Abstract (English)
Diffusion probabilistic models are traditionally used to generate colors at fixed pixel positions in 2D images. Building on this, we extend diffusion models to point cloud semantic segmentation, where point positions also remain fixed, and the diffusion model generates point labels instead of colors. To accelerate the denoising process in reverse diffusion, we introduce a noisy label embedding mechanism. This approach integrates semantic information into the noisy label, providing an initial semantic reference that improves the reverse diffusion efficiency. Additionally, we propose a point frequency transformer that enhances the adjustment of high-level context in point clouds. To reduce computational complexity, we introduce the position condition into MLP and propose denoising PointNet to process the high-resolution point cloud without sacrificing geometric details. Finally, we integrate the proposed noisy label embedding, point frequency transformer and denoising PointNet in our proposed dual conditional diffusion model-based network (PointDiffuse) to perform large-scale point cloud semantic segmentation. Extensive experiments on five benchmarks demonstrate the superiority of PointDiffuse, achieving the state-of-the-art mIoU of 74.2\% on S3DIS Area 5, 81.2\% on S3DIS 6-fold and 64.8\% on SWAN dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。