arXiv:2603.18427cs.CVcs.AI2026-03

用可控扩散模型生成高质量分割数据,兼顾多样性与可靠性。

R&D: Balancing Reliability and Diversity in Synthetic Data Augmentation for Semantic Segmentation

  • 引入类感知提示与视觉先验融合,控制生成图像结构。
  • 在PASCAL VOC和BDD100K上提升小样本场景下分割精度。
  • 适合数据稀缺的自动驾驶、医疗图像等像素级任务应用。

像素级语义分割的数据收集与标注成本高昂。数据增强可在不新增真实数据的情况下提升模型泛化能力。传统方法如平移、缩放、色彩变换仅产生几何变化,无法生成新结构;而生成模型常难以保持生成图像与原始图像的一致性,尤其在像素级任务中表现不佳。本文提出一种集成可控扩散模型的合成数据增强流程,有效平衡数据多样性与可靠性,弥合合成数据与真实数据的差距。通过类感知提示与视觉先验融合,进一步提升图像质量,确保与分割标签精确对齐。在PASCAL VOC和BDD100K等基准数据集上的实验表明,该方法显著提升了数据稀缺场景下的语义分割性能,并增强了模型在真实场景中的鲁棒性。代码已开源。

原文摘要 · Abstract (English)

Collecting and annotating datasets for pixel-level semantic segmentation tasks are highly labor-intensive. Data augmentation provides a viable solution by enhancing model generalization without additional real-world data collection. Traditional augmentation techniques, such as translation, scaling, and color transformations, create geometric variations but fail to generate new structures. While generative models have been employed to extend semantic information of datasets, they often struggle to maintain consistency between the original and generated images, particularly for pixel-level tasks. In this work, we propose a novel synthetic data augmentation pipeline that integrates controllable diffusion models. Our approach balances diversity and reliability data, effectively bridging the gap between synthetic and real data. We utilize class-aware prompting and visual prior blending to improve image quality further, ensuring precise alignment with segmentation labels. By evaluating benchmark datasets such as PASCAL VOC and BDD100K, we demonstrate that our method significantly enhances semantic segmentation performance, especially in data-scarce scenarios, while improving model robustness in real-world applications. Our code is available at \href{https://github.com/chequanghuy/Enhanced-Generative-Data-Augmentation-for-Semantic-Segmentation-via-Stronger-Guidance}{https://github.com/chequanghuy/Enhanced-Generative-Data-Augmentation-for-Semantic-Segmentation-via-Stronger-Guidance}.

语义分割生成增强扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。