arXiv:2412.18235cs.CV2024-12中稿 · ICASSP 2025被引 2

用文本提示融合遥感数据,提升城市气候区分类精度

Band Prompting Aided SAR and Multi-Spectral Data Fusion Framework for Local Climate Zone Classification

  • 用带组提示对齐多源遥感数据的波段特征
  • 在多个数据集上分类准确率提升显著
  • 适合遥感图像分析与城市气候研究者

城市气候区(LCZ)分类对于理解城市化与局部气候之间的复杂关系具有重要意义。近年来,融合合成孔径雷达(SAR)与多光谱数据以提升分类性能的研究日益增多,但因两类数据物理特性差异大且缺乏有效融合引导,仍面临挑战。本文提出一种新型带组提示辅助的数据融合框架BP-LCZ,利用与波段组相关的文本提示,引导模型学习不同波段的物理属性及各类别的语义信息,从而增强融合特征并提升分类性能。具体地,引入带组提示(BGP)策略,在波段组层面实现视觉表征的有效对齐,并结合文本信息更充分提取各波段的语义。此外,提出基于多变量监督矩阵(MSM)的训练策略,通过完善监督信息缓解正负样本混淆问题。实验结果验证了该框架的有效性与优越性。

原文摘要 · Abstract (English)

Local climate zone (LCZ) classification is of great value for understanding the complex interactions between urban development and local climate. Recent studies have increasingly focused on the fusion of synthetic aperture radar (SAR) and multi-spectral data to improve LCZ classification performance. However, it remains challenging due to the distinct physical properties of these two types of data and the absence of effective fusion guidance. In this paper, a novel band prompting aided data fusion framework is proposed for LCZ classification, namely BP-LCZ, which utilizes textual prompts associated with band groups to guide the model in learning the physical attributes of different bands and semantics of various categories inherent in SAR and multi-spectral data to augment the fused feature, thus enhancing LCZ classification performance. Specifically, a band group prompting (BGP) strategy is introduced to align the visual representation effectively at the level of band groups, which also facilitates a more adequate extraction of semantic information of different bands with textual information. In addition, a multivariate supervised matrix (MSM) based training strategy is proposed to alleviate the problem of positive and negative sample confusion by completing the supervised information. The experimental results demonstrate the effectiveness and superiority of the proposed data fusion framework.

遥感融合城市气候提示学习多源数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。