用早期融合+无参模块,让遥感变化检测更简单高效
EoCD: Encoder only Remote Sensing Change Detection
- 早融合输入图像,用无参数多尺度融合替代复杂解码器
- 在4个数据集上达到领先性能,且推理速度更快
- 证明编码器决定模型效果,解码器可简化甚至移除
作为时序分析的核心任务,变化检测在现代地球观测中至关重要。现有方法依赖孪生编码器分别提取时序特征再进行后期融合,随后设计复杂解码器提升性能,导致整体计算开销和网络复杂度上升。少数早期融合方法虽避免了孪生编码器的额外开销,但仍依赖复杂解码器,且性能不如后期融合方法。为此,我们提出仅编码器变化检测(EoCD),通过早期融合时序数据,并以无参数多尺度特征融合模块替代解码器,显著降低模型复杂度。EoCD在多种编码器架构下实现了性能与推理速度的最佳平衡。大量实验表明,模型性能主要取决于编码器,解码器仅为附加组件。在四个挑战性变化检测数据集上的实验证明了该方法的有效性。
原文摘要 · Abstract (English)
Being a cornerstone of temporal analysis, change detection has been playing a pivotal role in modern earth observation. Existing change detection methods rely on the Siamese encoder to individually extract temporal features followed by temporal fusion. Subsequently, these methods design sophisticated decoders to improve the change detection performance without taking into consideration the complexity of the model. These aforementioned issues intensify the overall computational cost as well as the network's complexity which is undesirable. Alternatively, few methods utilize the early fusion scheme to combine the temporal images. These methods prevent the extra overhead of Siamese encoder, however, they also rely on sophisticated decoders for better performance. In addition, these methods demonstrate inferior performance as compared to late fusion based methods. To bridge these gaps, we introduce encoder only change detection (EoCD) that is a simple and effective method for the change detection task. The proposed method performs the early fusion of the temporal data and replaces the decoder with a parameter-free multiscale feature fusion module thereby significantly reducing the overall complexity of the model. EoCD demonstrate the optimal balance between the change detection performance and the prediction speed across a variety of encoder architectures. Additionally, EoCD demonstrate that the performance of the model is predominantly dependent on the encoder network, making the decoder an additional component. Extensive experimentation on four challenging change detection datasets reveals the effectiveness of the proposed method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。