arXiv:2505.17783cs.CV2025-05中稿 · BMVC 2025被引 2

用扩散模型生成带语义标签的点云,解决小样本分割数据不足问题。

Generative Data Augmentation for Object Point Cloud Segmentation

  • 基于扩散模型改进生成机制,支持条件生成带分割标签的点云。
  • 仅需少量标注样本,生成数据使模型在多个数据集上性能显著提升。
  • 适合医疗等标注成本高的点云分割场景,尤其小样本应用。

数据增强广泛用于缓解深度学习中的数据稀缺问题。传统方法依赖旋转、缩放等简单几何变换,难以提升数据多样性与模型性能。当前先进的3D形状生成模型多基于去噪扩散概率模型,可生成逼真的新点云,但缺乏点级语义标签,限制其在点云分割训练中的应用。为弥合这一差距,我们扩展了先进的3D扩散模型Lion,构建了一个部件感知的生成模型,可基于给定分割掩码生成高质量点云。利用该模型,提出一个三步生成式数据增强(GDA)流程:仅需少量标注样本,即可生成多样化变体与伪标签样本,并通过基于扩散的伪标签过滤方法进行验证。在两个大规模合成数据集和一个真实世界医学数据集上的大量实验表明,该方法优于传统数据增强及相关的半监督与自监督方法。

原文摘要 · Abstract (English)

Data augmentation is widely used to train deep learning models to address data scarcity. However, traditional data augmentation (TDA) typically relies on simple geometric transformation, such as random rotation and rescaling, resulting in minimal data diversity enrichment and limited model performance improvement. State-of-the-art generative models for 3D shape generation rely on the denoising diffusion probabilistic models and manage to generate realistic novel point clouds for 3D content creation and manipulation. Nevertheless, the generated 3D shapes lack associated point-wise semantic labels, restricting their usage in enlarging the training data for point cloud segmentation tasks. To bridge the gap between data augmentation techniques and the advanced diffusion models, we extend the state-of-the-art 3D diffusion model, Lion, to a part-aware generative model that can generate high-quality point clouds conditioned on given segmentation masks. Leveraging the novel generative model, we introduce a 3-step generative data augmentation (GDA) pipeline for point cloud segmentation training. Our GDA approach requires only a small amount of labeled samples but enriches the training data with generated variants and pseudo-labeled samples, which are validated by a novel diffusion-based pseudo-label filtering method. Extensive experiments on two large-scale synthetic datasets and a real-world medical dataset demonstrate that our GDA method outperforms TDA approach and related semi-supervised and self-supervised methods.

点云分割生成模型数据增强扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。