arXiv:2501.07390cs.CV2025-01被引 12

用Kolmogorov-Arnold网络提升遥感图像语义分割精度与可解释性

Kolmogorov-Arnold Network for Remote Sensing Image Semantic Segmentation

  • 基于KAN的深度特征精炼模块,捕捉高维特征中的复杂空间关系
  • 用KAN替代解码器中的MLP,显著提升细节恢复能力,提升分割精度
  • 模型具备可解释性,适合需要透明决策的遥感应用

语义分割在遥感应用中至关重要,准确提取和表征特征对高质量结果至关重要。尽管编码器-解码器架构广泛应用,现有方法常难以充分利用编码器提取的高维特征,并在解码过程中高效恢复细节信息。为此,我们提出一种新型语义分割网络DeepKANSeg,包含两项基于新兴Kolmogorov-Arnold网络(KAN)的关键创新。首先,引入基于KAN的深度特征精炼模块DeepKAN,有效捕捉高维特征中的复杂空间与丰富语义关系。其次,将解码器中全局-局部融合模块的传统多层感知机(MLP)替换为基于KAN的线性层,即GLKAN,增强解码时对细粒度细节的捕捉能力。在两个知名高分辨率遥感基准数据集ISPRS Vaihingen和ISPRS Potsdam上的实验表明,该KAN增强模型在精度上优于现有先进方法,凸显了KAN作为传统架构替代方案在语义分割任务中的潜力。此外,显式的单变量分解提供了更好的可解释性,尤其适用于遥感中需要可解释学习的应用场景。

原文摘要 · Abstract (English)

Semantic segmentation plays a crucial role in remote sensing applications, where the accurate extraction and representation of features are essential for high-quality results. Despite the widespread use of encoder-decoder architectures, existing methods often struggle with fully utilizing the high-dimensional features extracted by the encoder and efficiently recovering detailed information during decoding. To address these problems, we propose a novel semantic segmentation network, namely DeepKANSeg, including two key innovations based on the emerging Kolmogorov Arnold Network (KAN). Notably, the advantage of KAN lies in its ability to decompose high-dimensional complex functions into univariate transformations, enabling efficient and flexible representation of intricate relationships in data. First, we introduce a KAN-based deep feature refinement module, namely DeepKAN to effectively capture complex spatial and rich semantic relationships from high-dimensional features. Second, we replace the traditional multi-layer perceptron (MLP) layers in the global-local combined decoder with KAN-based linear layers, namely GLKAN. This module enhances the decoder's ability to capture fine-grained details during decoding. To evaluate the effectiveness of the proposed method, experiments are conducted on two well-known fine-resolution remote sensing benchmark datasets, namely ISPRS Vaihingen and ISPRS Potsdam. The results demonstrate that the KAN-enhanced segmentation model achieves superior performance in terms of accuracy compared to state-of-the-art methods. They highlight the potential of KANs as a powerful alternative to traditional architectures in semantic segmentation tasks. Moreover, the explicit univariate decomposition provides improved interpretability, which is particularly beneficial for applications requiring explainable learning in remote sensing.

遥感分割KAN网络可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。