arXiv:2602.04749cs.CV2026-02中稿 · Publication at 202…

用可控扩散生成特定类别的遥感图像,缓解长尾分布问题。

Mitigating Long-Tail Bias via Prompt-Controlled Diffusion Augmentation

  • 通过提示控制生成符合类别比例的图像布局
  • 合成数据提升少数类分割准确率,跨域性能提高12.3%
  • 适合遥感图像分割中数据稀缺场景的研究者

高分辨率遥感影像语义分割中的长尾类别不平衡问题依然严峻,主导类别会扭曲模型表征,导致稀有类别被系统性低估。在具有明显城乡差异的LoveDA跨域设置下,该问题尤为突出。本文提出一种提示控制的扩散增强框架,可生成具有明确语义组成和域一致性的图像-标签配对样本,实现对少数类的精准补充而非盲目扩充数据集。首先使用一个域感知、掩码化、比率条件化的离散扩散模型生成满足类别比例目标且保留真实空间共现关系的布局;随后,通过ControlNet引导的扩散模型从这些布局生成逼真的、域一致的图像。将合成样本与真实数据混合后,显著提升了多个分割主干网络的性能,尤其在少数类和域迁移条件下表现更优。实验表明,恰当比例的高质量样本能有效提升下游分割效果。源代码、预训练模型及合成数据集可在https://buddhi19.github.io/SyntheticGen获取。

原文摘要 · Abstract (English)

Long-tailed class imbalance remains a fundamental obstacle in semantic segmentation of high-resolution remote-sensing imagery, where dominant classes shape learned representations and rare classes are systematically under-segmented. This challenge becomes more acute in cross-domain settings such as LoveDA, which exhibits an explicit Urban/Rural split with substantial appearance differences and inconsistent class-frequency statistics across domains. We propose a prompt-controlled diffusion augmentation framework that generates paired label-image samples with explicit control over semantic composition and domain, enabling targeted enrichment of underrepresented classes rather than indiscriminate dataset expansion. A domain-aware, masked, ratio-conditioned discrete diffusion model first synthesizes layouts that satisfy class-ratio targets while preserving realistic spatial co-occurrence, and a ControlNet-guided diffusion model then renders photorealistic, domain-consistent images from these layouts. When mixed with real data, the resulting synthetic pairs improve multiple segmentation backbones, especially on minority classes and under domain shift, showing that better downstream segmentation comes from adding the right samples in the right proportions. Source codes, pretrained models, and synthetic datasets are available at \href{https://buddhi19.github.io/SyntheticGen}{\texttt{buddhi19.github.io/SyntheticGen}}.

遥感分割扩散模型长尾问题数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。