提出联合建筑提取与变化检测的新模型,提升遥感图像解析精度。
MSSFC-Net:Enhancing Building Interpretation with Multi-Scale Spatial-Spectral Feature Collaboration
- 双分支多尺度特征提取,协同融合空间与光谱信息
- 在三个基准数据集上同时提升提取与检测准确率
- 适合遥感图像分析、城市监测等应用领域
从遥感影像中进行建筑解析主要涉及建筑提取和变化检测两项基础任务。然而,现有方法通常独立处理这两项任务,忽视其内在关联,未能充分利用共享特征表示实现相互增强。此外,建筑在光谱、空间和尺度上的多样性,使得联合建模多尺度时空特征并平衡精确率与召回率面临挑战。空间与光谱表征间的协同不足常导致检测精度下降和变化定位不完整。为此,本文提出多尺度时空特征协同双任务网络(MSSFC-Net),将建筑提取与变化检测统一于一个架构中,利用任务互补性同步提取建筑与变化特征。设计了具有时空特征协同的双分支多尺度特征提取模块(DMFE),有效捕捉浅层纹理细节与深层语义信息,提升建筑提取性能。针对时序特征聚合,引入多尺度差异融合模块(MDFM),显式建模差异特征与双时相特征的交互,增强对大范围变化和细微结构变动的检测能力。在三个基准数据集上的大量实验表明,MSSFC-Net在建筑提取与变化检测任务上均取得优异表现,显著提升检测精度且保持完整性。
原文摘要 · Abstract (English)
Building interpretation from remote sensing imagery primarily involves two fundamental tasks: building extraction and change detection. However, most existing methods address these tasks independently, overlooking their inherent correlation and failing to exploit shared feature representations for mutual enhancement. Furthermore, the diverse spectral,spatial, and scale characteristics of buildings pose additional challenges in jointly modeling spatial-spectral multi-scale features and effectively balancing precision and recall. The limited synergy between spatial and spectral representations often results in reduced detection accuracy and incomplete change localization.To address these challenges, we propose a Multi-Scale Spatial-Spectral Feature Cooperative Dual-Task Network (MSSFC-Net) for joint building extraction and change detection in remote sensing images. The framework integrates both tasks within a unified architecture, leveraging their complementary nature to simultaneously extract building and change features. Specifically,a Dual-branch Multi-scale Feature Extraction module (DMFE) with Spatial-Spectral Feature Collaboration (SSFC) is designed to enhance multi-scale representation learning, effectively capturing shallow texture details and deep semantic information, thus improving building extraction performance. For temporal feature aggregation, we introduce a Multi-scale Differential Fusion Module (MDFM) that explicitly models the interaction between differential and dual-temporal features. This module refines the network's capability to detect large-area changes and subtle structural variations in buildings. Extensive experiments conducted on three benchmark datasets demonstrate that MSSFC-Net achieves superior performance in both building extraction and change detection tasks, effectively improving detection accuracy while maintaining completeness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。