用更强引导生成高质量分割数据,提升小样本学习效果。
Enhanced Generative Data Augmentation for Semantic Segmentation via Stronger Guidance
- 通过类别提示与视觉先验融合,精准引导扩散模型生成
- 在PASCAL VOC上生成高质量合成图像,显著提升分割性能
- 适合数据稀缺场景下的语义分割模型训练
像素级标注任务如语义分割对标注成本要求高。传统数据增强方法(如旋转、翻转)难以在关键语义维度上生成多样样本,且无法改变高层语义结构。生成模型可生成合成图像,但可控生成仍面临提示与视觉参考有效性挑战。本文提出基于可控扩散模型的数据增强流程,采用类别提示追加与视觉先验融合策略,强化模型对标注类别的关注,确保生成图像保持原始分割结构。同时引入类别平衡算法,在合并真实与合成数据时维持类别分布均衡。在PASCAL VOC数据集上的评估表明,该方法能有效生成高质量合成图像,显著提升分割性能。代码已开源。
原文摘要 · Abstract (English)
Data augmentation is crucial for pixel-wise annotation tasks like semantic segmentation, where labeling requires significant effort and intensive labor. Traditional methods, involving simple transformations such as rotations and flips, create new images but often lack diversity along key semantic dimensions and fail to alter high-level semantic properties. To address this issue, generative models have emerged as an effective solution for augmenting data by generating synthetic images. Controllable Generative models offer data augmentation methods for semantic segmentation tasks by using prompts and visual references from the original image. However, these models face challenges in generating synthetic images that accurately reflect the content and structure of the original image due to difficulties in creating effective prompts and visual references. In this work, we introduce an effective data augmentation pipeline for semantic segmentation using Controllable Diffusion model. Our proposed method includes efficient prompt generation using Class-Prompt Appending and Visual Prior Blending to enhance attention to labeled classes in real images, allowing the pipeline to generate a precise number of augmented images while preserving the structure of segmentation-labeled classes. In addition, we implement a class balancing algorithm to ensure a balanced training dataset when merging the synthetic and original images. Evaluation on PASCAL VOC datasets, our pipeline demonstrates its effectiveness in generating high-quality synthetic images for semantic segmentation. Our code is available at https://github.com/chequanghuy/Enhanced-Generative-Data-Augmentation-for-Semantic-Segmentation-via-Stronger-Guidance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。