arXiv:2412.08116cs.CVcs.LG2024-12被引 2

用扩散模型生成带软标签的 SAR 油污图像,解决数据少难题

Diffusion-based Data Augmentation and Knowledge Distillation with Generated Soft Labels Solving Data Scarcity Problems of SAR Oil Spill Segmentation

  • 用扩散模型生成油污图像和软标签,提供更丰富的概率信息
  • 在 SAR 图像上提升分割性能,相比其他方法显著领先
  • 适合数据稀缺场景下的遥感图像分割研究者

油污带来严重环境风险,早期检测对响应与缓解至关重要。合成孔径雷达(SAR)可在全天候条件下工作,使基于 SAR 的油污分割具备快速稳健监测能力。然而,深度学习模型训练时常受限于标注数据稀缺。为此,本文提出基于扩散的数据增强与知识迁移策略(DAKTer)。该策略使扩散模型生成 SAR 油污图像及其对应的软标签对,相较于分割掩码(硬标签),软标签提供更丰富的像素级类别概率分布。为确保高质量图像与对齐软标签的联合生成,引入基于信噪比(SNR)的平衡因子,统一两类模态的噪声污染过程。利用生成的图像与软标签,学生分割模型无需依赖同任务教师模型即可学习鲁棒特征表示,有效区分油污区域与相似背景。大量实验表明,DAKTer 能有效将像素级类别概率知识迁移到学生模型,显著提升其区分能力。相比其他生成式数据增强方法,本策略使多种分割模型性能大幅领先。

原文摘要 · Abstract (English)

Oil spills pose severe environmental risks, making early detection crucial for effective response and mitigation. As Synthetic Aperture Radar (SAR) images operate under all-weather conditions, SAR-based oil spill segmentation enables fast and robust monitoring. However, when using deep learning models, SAR oil spill segmentation often struggles in training due to the scarcity of labeled data. To address this limitation, we propose a diffusion-based data augmentation with knowledge transfer (DAKTer) strategy. Our DAKTer strategy enables a diffusion model to generate SAR oil spill images along with soft label pairs, which offer richer class probability distributions than segmentation masks (i.e. hard labels). Also, for reliable joint generation of high-quality SAR images and well-aligned soft labels, we introduce an SNR-based balancing factor aligning the noise corruption process of both modalilties in diffusion models. By leveraging the generated SAR images and soft labels, a student segmentation model can learn robust feature representations without teacher models trained for the same task, improving its ability to segment oil spill regions. Extensive experiments demonstrate that our DAKTer strategy effectively transfers the knowledge of per-pixel class probabilities to the student segmentation model to distinguish the oil spill regions from other look-alike regions in the SAR images. Our DAKTer strategy boosts various segmentation models to achieve superior performance with large margins compared to other generative data augmentation methods.

油污分割扩散模型数据增强遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。