用扩散模型直接生成语义分割和变化检测图,无需采样,速度快且准确。
Noise2Map: End-to-End Diffusion Model for Semantic Segmentation and Change Detection

- 利用去噪过程直接预测分割图和变化图,端到端训练。
- 在三个遥感数据集上平均F1和交并比均排名第一。
- 支持多任务学习,对噪声调度和时间步控制鲁棒。
语义分割和变化检测是遥感领域的基础挑战,需从卫星图像中捕捉空间语义或时序差异。现有深度学习模型常面临时序不一致、细粒度结构捕捉困难、需大量预训练且可解释性差等问题。扩散模型通过去噪过程系统性地学习数据表示,为此我们提出Noise2Map:一个统一的基于扩散的框架,将去噪过程重新用于判别任务。不同于仅用于生成或特征提取的先验方法,Noise2Map通过特定任务的噪声调度和时间步条件,直接预测语义图或变化图,避免传统扩散模型的高成本采样。模型通过自监督去噪预训练,再以监督微调,兼具可解释性与鲁棒性。共享主干网络结合任务特定噪声调度器,同时支持语义分割(SS)与变化检测(CD)。在SpaceNet7、WHU及xView2(野火损毁建筑)数据集上的实验表明,Noise2Map在语义分割上平均排名第一,在变化检测上按跨数据集排名指标(平均F1主指标,交并比作为平局决胜)也排名第一。消融研究验证了模型对不同训练噪声调度和时间步控制的鲁棒性,以及多任务学习能力。
原文摘要 · Abstract (English)
Semantic segmentation and change detection are two fundamental challenges in remote sensing, requiring models to capture either spatial semantics or temporal differences from satellite imagery. Existing deep learning models often struggle with temporal inconsistencies or in capturing fine-grained spatial structures, require extensive pretraining, and offer limited interpretability - especially in real-world remote sensing scenarios. Recent advances in diffusion models show that Gaussian noise can be systematically leveraged to learn expressive data representations through denoising. Motivated by this, we investigate whether the noise process in diffusion models can be effectively utilized for discriminative tasks. We propose Noise2Map, a unified diffusion-based framework that repurposes the denoising process for fast, end-to-end discriminative learning. Unlike prior work that uses diffusion only for generation or feature extraction, Noise2Map directly predicts semantic or change maps using task-specific noise schedules and timestep conditioning, avoiding the costly sampling procedures of traditional diffusion models. The model is pretrained via self-supervised denoising and fine-tuned with supervision, enabling both interpretability and robustness. Our architecture supports both tasks (SS and CD) through a shared backbone and task-specific noise schedulers. Extensive evaluations on the SpaceNet7, WHU, and xView2 buildings damaged by wildfires datasets demonstrate that Noise2Map ranks on average 1st among seven models on semantic segmentation and 1st on change detection by a cross-dataset rank metric (average F1 primary, IoU tie-break). Ablation studies highlight the robustness of our model against different training noise schedulers and timestep control in the diffusion process, as well as the ability of the model to perform multi-task learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。