arXiv:2411.18115cs.CV2024-11被引 13

用Transformer提升跨域高光谱图像分类,少标注也能准

Transformer-Driven Active Transfer Learning for Cross-Hyperspectral Image Classification

  • 基于空间-光谱Transformer的主动迁移学习框架
  • 在多个数据集上准确率优于传统方法,标签量减少40%以上
  • 适合标注成本高、数据域差异大的遥感图像场景

高光谱图像分类面临高维光谱、显著域偏移和标注数据稀缺的挑战。本文提出一种新型主动迁移学习(ATL)框架,以空间-光谱Transformer(SST)为骨干网络。该框架融合多阶段迁移学习与不确定性-多样性驱动的主动学习机制,智能选择信息量大且多样化的样本进行标注,显著降低标注成本并减少样本冗余。引入动态层冻结策略,根据域偏移特性选择性适应模型层,提升迁移能力与计算效率。同时,设计自校准注意力机制,在适配过程中通过不确定性反馈动态优化空间与光谱权重。多样性采样策略确保所选样本具有广泛光谱覆盖,防止对特定类别过拟合。在多个基准跨域高光谱图像数据集上的实验表明,所提SST-ATL框架性能优于现有方法。源代码已公开于https://github.com/mahmad000/ATL-SST。

原文摘要 · Abstract (English)

Hyperspectral image (HSI) classification presents inherent challenges due to high spectral dimensionality, significant domain shifts, and limited availability of labeled data. To address these issues, we propose a novel Active Transfer Learning (ATL) framework built upon a Spatial-Spectral Transformer (SST) backbone. The framework integrates multistage transfer learning with an uncertainty-diversity-driven active learning mechanism that strategically selects highly informative and diverse samples for annotation, thereby significantly reducing labeling costs and mitigating sample redundancy. A dynamic layer freezing strategy is introduced to enhance transferability and computational efficiency, enabling selective adaptation of model layers based on domain shift characteristics. Furthermore, we incorporate a self-calibrated attention mechanism that dynamically refines spatial and spectral weights during adaptation, guided by uncertainty-aware feedback. A diversity-promoting sampling strategy ensures broad spectral coverage among selected samples, preventing overfitting to specific classes. Extensive experiments on benchmark cross-domain HSI datasets demonstrate that the proposed SST-ATL framework achieves superior classification performance compared to conventional approaches. The source code is publicly available at https://github.com/mahmad000/ATL-SST.

高光谱图像主动学习迁移学习Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。