arXiv:2505.17721cs.CV2025-05CVPR被引 7

生成带精细语义分割的3D点云,提升结构与部件一致性

SeaLion: Semantic Part-Aware Latent Point Diffusion Models for 3D Generation

  • 通过感知语义部件的潜空间扩散机制,联合预测噪声与分割标签
  • 在ShapeNet和IntrA数据集上1-NNA(p-CD)分别领先SOTA 13.33%和6.52%
  • 支持半监督训练,适用于3D形状编辑与分割模型的数据增强

去噪扩散概率模型在点云生成中取得显著进展,广泛应用于生成式数据增强和3D模型编辑。然而,针对带点级分割标签的点云生成及其评估指标的研究仍较少。为此,本文提出SeaLion,一种新型扩散模型,可生成高质量且多样化的带细粒度分割标签的点云。具体地,引入语义部件感知的潜空间点扩散技术,利用生成模型中间特征,在去噪过程中联合预测扰动潜点的噪声及对应的部件分割标签,并基于分割标签解码潜点生成点云。为有效评估生成点云质量,提出一种新的点云成对距离计算方法——部件感知切比雪夫距离(p-CD),使现有指标如1-NNA能同时衡量局部结构质量与部件间一致性。在大规模合成数据集ShapeNet和真实世界医疗数据集IntrA上的实验表明,SeaLion在生成质量和多样性上表现优异,相比现有SOTA模型DiffFacto,在两个数据集上1-NNA(p-CD)分别提升13.33%和6.52%。实验分析显示,SeaLion可实现半监督训练,降低标注需求。最后验证其在训练分割模型的生成式数据增强中的适用性,以及作为部件感知3D形状编辑工具的能力。

原文摘要 · Abstract (English)

Denoising diffusion probabilistic models have achieved significant success in point cloud generation, enabling numerous downstream applications, such as generative data augmentation and 3D model editing. However, little attention has been given to generating point clouds with point-wise segmentation labels, as well as to developing evaluation metrics for this task. Therefore, in this paper, we present SeaLion, a novel diffusion model designed to generate high-quality and diverse point clouds with fine-grained segmentation labels. Specifically, we introduce the semantic part-aware latent point diffusion technique, which leverages the intermediate features of the generative models to jointly predict the noise for perturbed latent points and associated part segmentation labels during the denoising process, and subsequently decodes the latent points to point clouds conditioned on part segmentation labels. To effectively evaluate the quality of generated point clouds, we introduce a novel point cloud pairwise distance calculation method named part-aware Chamfer distance (p-CD). This method enables existing metrics, such as 1-NNA, to measure both the local structural quality and inter-part coherence of generated point clouds. Experiments on the large-scale synthetic dataset ShapeNet and real-world medical dataset IntrA demonstrate that SeaLion achieves remarkable performance in generation quality and diversity, outperforming the existing state-of-the-art model, DiffFacto, by 13.33% and 6.52% on 1-NNA (p-CD) across the two datasets. Experimental analysis shows that SeaLion can be trained semi-supervised, thereby reducing the demand for labeling efforts. Lastly, we validate the applicability of SeaLion in generative data augmentation for training segmentation models and the capability of SeaLion to serve as a tool for part-aware 3D shape editing.

3D生成扩散模型语义分割点云

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。