arXiv:2503.03465cs.CVeess.IV2025-03被引 6

提出DTU-Net模型,解决高光谱解混中多尺度与非线性问题。

DTU-Net: A Multi-Scale Dilated Transformer Network for Nonlinear Hyperspectral Unmixing

  • 采用多尺度空洞注意力捕捉长程空间相关性
  • 在合成与真实数据集上优于现有方法,尤其在非线性场景
  • 适合处理含非线性混合效应的高光谱解混任务

Transformer在高光谱解混(HU)中表现优异,但现有基于ViT或Swin-Transformer的方法难以有效捕捉多尺度和长程空间相关性。同时,它们依赖线性混合模型,难以应对显著的非线性效应。为此,本文提出多尺度空洞Transformer网络(DTU-Net),用于非线性高光谱解混。编码器包含双分支:第一分支通过空洞Transformer中的多尺度空洞注意力(MSDA)以不同膨胀率捕捉多尺度与长程空间特征;第二分支利用带通道注意力的3D-CNN提取光谱特征。两分支输出融合后输入解码器,估计组分含量。解码器支持线性与非线性混合,基于多项式后非线性混合模型(PPNMM)显式建模端元、含量与非线性系数间关系,增强可解释性。在合成与真实数据集上的实验表明,DTU-Net性能优于基于PPNMM的方法及多种先进解混网络。

原文摘要 · Abstract (English)

Transformers have shown significant success in hyperspectral unmixing (HU). However, challenges remain. While multi-scale and long-range spatial correlations are essential in unmixing tasks, current Transformer-based unmixing networks, built on Vision Transformer (ViT) or Swin-Transformer, struggle to capture them effectively. Additionally, current Transformer-based unmixing networks rely on the linear mixing model, which lacks the flexibility to accommodate scenarios where nonlinear effects are significant. To address these limitations, we propose a multi-scale Dilated Transformer-based unmixing network for nonlinear HU (DTU-Net). The encoder employs two branches. The first one performs multi-scale spatial feature extraction using Multi-Scale Dilated Attention (MSDA) in the Dilated Transformer, which varies dilation rates across attention heads to capture long-range and multi-scale spatial correlations. The second one performs spectral feature extraction utilizing 3D-CNNs with channel attention. The outputs from both branches are then fused to integrate multi-scale spatial and spectral information, which is subsequently transformed to estimate the abundances. The decoder is designed to accommodate both linear and nonlinear mixing scenarios. Its interpretability is enhanced by explicitly modeling the relationships between endmembers, abundances, and nonlinear coefficients in accordance with the polynomial post-nonlinear mixing model (PPNMM). Experiments on synthetic and real datasets validate the effectiveness of the proposed DTU-Net compared to PPNMM-derived methods and several advanced unmixing networks.

高光谱解混Transformer非线性模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。