arXiv:2412.17247cs.CV2024-12

提出首个专为遥感变化检测设计的时空交互Transformer架构。

STeInFormer: Spatial-Temporal Interaction Transformer Architecture for Remote Sensing Change Detection

  • 设计时空交互Transformer,增强多时相特征提取能力
  • 在三个数据集上超越现有方法,实现最优精度与效率平衡
  • 引入无参多频段标记混合器,融合光谱信息提升检测性能

卷积神经网络和注意力机制因出色的判别能力,显著推动了遥感变化检测(RSCD)的发展。现有方法普遍采用非交互式孪生网络进行多时相特征提取,并通过变化检测头完成特征融合与变化表征,但该范式未充分考虑变化检测在时空维度上的特性,导致时空交互不足,影响高质量特征提取。为此,本文提出STeInFormer,一种专为多时相特征提取设计的时空交互Transformer架构,是首个针对RSCD任务的通用骨干网络。同时,提出无参多频段标记混合器,用于融合提供光谱信息的频域特征。在三个数据集上的实验验证了该方法的有效性,其性能优于现有最先进方法,且实现了最佳的效率-精度权衡。代码已开源:https://github.com/xwmaxwma/rschange。

原文摘要 · Abstract (English)

Convolutional neural networks and attention mechanisms have greatly benefited remote sensing change detection (RSCD) because of their outstanding discriminative ability. Existent RSCD methods often follow a paradigm of using a non-interactive Siamese neural network for multi-temporal feature extraction and change detection heads for feature fusion and change representation. However, this paradigm lacks the contemplation of the characteristics of RSCD in temporal and spatial dimensions, and causes the drawback on spatial-temporal interaction that hinders high-quality feature extraction. To address this problem, we present STeInFormer, a spatial-temporal interaction Transformer architecture for multi-temporal feature extraction, which is the first general backbone network specifically designed for RSCD. In addition, we propose a parameter-free multi-frequency token mixer to integrate frequency-domain features that provide spectral information for RSCD. Experimental results on three datasets validate the effectiveness of the proposed method, which can outperform the state-of-the-art methods and achieve the most satisfactory efficiency-accuracy trade-off. Code is available at https://github.com/xwmaxwma/rschange.

遥感变化检测Transformer时空建模多频段融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。