arXiv:2507.01573cs.CV2025-07TPAMI被引 3

融合判别与生成学习,精准优化遥感图像语义分割边界。

A Gift from the Integration of Discriminative and Diffusion-based Generative Learning: Boundary Refinement Remote Sensing Semantic Segmentation

  • 用判别模型生成粗分割图,再通过扩散模型迭代去噪精修边界。
  • 在五个遥感数据集上均实现边界精度显著提升,跨架构兼容性强。
  • 适合需要高精度边界分割的遥感分析、测绘与环境监测任务。

遥感语义分割需同时准确识别地物类别与精确定位其位置。现有方法多依赖判别学习,擅长捕捉低频特征但难以学习高频边界细节。近期研究表明,扩散生成模型在生成高频细节方面表现优异。本文理论分析证实,扩散去噪过程显著增强模型对高频特征的学习能力,但仅以原图引导时,其低频语义推理不足。为此,提出判别与生成学习融合框架IDGBR:先用判别主干网络生成粗分割图,再通过条件引导网络联合学习指导表示,驱动迭代去噪扩散过程精修边界。在五个遥感语义分割数据集(含二分类与多分类)上的实验表明,该框架能一致提升多种判别架构输出的粗分割结果的边界精度。

原文摘要 · Abstract (English)

Remote sensing semantic segmentation must address both what the ground objects are within an image and where they are located. Consequently, segmentation models must ensure not only the semantic correctness of large-scale patches (low-frequency information) but also the precise localization of boundaries between patches (high-frequency information). However, most existing approaches rely heavily on discriminative learning, which excels at capturing low-frequency features, while overlooking its inherent limitations in learning high-frequency features for semantic segmentation. Recent studies have revealed that diffusion generative models excel at generating high-frequency details. Our theoretical analysis confirms that the diffusion denoising process significantly enhances the model's ability to learn high-frequency features; however, we also observe that these models exhibit insufficient semantic inference for low-frequency features when guided solely by the original image. Therefore, we integrate the strengths of both discriminative and generative learning, proposing the Integration of Discriminative and diffusion-based Generative learning for Boundary Refinement (IDGBR) framework. The framework first generates a coarse segmentation map using a discriminative backbone model. This map and the original image are fed into a conditioning guidance network to jointly learn a guidance representation subsequently leveraged by an iterative denoising diffusion process refining the coarse segmentation. Extensive experiments across five remote sensing semantic segmentation datasets (binary and multi-class segmentation) confirm our framework's capability of consistent boundary refinement for coarse results from diverse discriminative architectures.

遥感分割扩散模型边界优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。