通过自适应频域交互提升遥感图像语义分割精度
Adaptive Frequency Enhancement Network for Remote Sensing Image Semantic Segmentation
- 根据输入图像动态分离高低频特征,实现内容自适应调制
- 在三个公开数据集上达到优于现有方法的分割性能
- 适合处理多样地貌与复杂场景的遥感图像分析
高分辨率遥感图像的语义分割在土地利用监测和城市规划中至关重要。近年来深度学习方法取得显著进展,但仍面临网络参数难以适应不同地表覆盖分布、时空与频域特征交互不足的问题。为此,本文提出自适应频率增强网络(AFENet),包含两个核心模块:自适应频域与空间特征交互模块(AFSIM)和选择性特征融合模块(SFM)。AFSIM根据输入图像内容动态分离并调制高低频特征,自适应生成两个掩码以分离高频与低频成分,从而为地物特征表示提供最优细节与上下文信息。SFM则选择性融合全局上下文与局部细节特征,进一步增强网络表征能力。在三个公开数据集上的大量实验表明,AFENet性能优于当前最先进方法。同时验证了AFSIM与SFM在多样化地表类型与复杂场景下的有效性。代码已开源:https://github.com/oucailab/AFENet。
原文摘要 · Abstract (English)
Semantic segmentation of high-resolution remote sensing images plays a crucial role in land-use monitoring and urban planning. Recent remarkable progress in deep learning-based methods makes it possible to generate satisfactory segmentation results. However, existing methods still face challenges in adapting network parameters to various land cover distributions and enhancing the interaction between spatial and frequency domain features. To address these challenges, we propose the Adaptive Frequency Enhancement Network (AFENet), which integrates two key components: the Adaptive Frequency and Spatial feature Interaction Module (AFSIM) and the Selective feature Fusion Module (SFM). AFSIM dynamically separates and modulates high- and low-frequency features according to the content of the input image. It adaptively generates two masks to separate high- and low-frequency components, therefore providing optimal details and contextual supplementary information for ground object feature representation. SFM selectively fuses global context and local detailed features to enhance the network's representation capability. Hence, the interactions between frequency and spatial features are further enhanced. Extensive experiments on three publicly available datasets demonstrate that the proposed AFENet outperforms state-of-the-art methods. In addition, we also validate the effectiveness of AFSIM and SFM in managing diverse land cover types and complex scenarios. Our codes are available at https://github.com/oucailab/AFENet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。