无标签跨域遥感图像分类新方法,少样本下表现更稳。
Cross-Domain Transfer with Self-Supervised Spectral-Spatial Modeling for Hyperspectral Image Classification
- 自监督学习融合光谱与空间特征,无需源域标签。
- 在四个数据集上实现稳定分类,少样本时性能提升显著。
- 适合遥感、农业等标注稀缺场景的模型迁移应用。
自监督学习在高光谱表征中展现出巨大潜力,但在跨域迁移场景中仍缺乏深入探索。现有方法依赖源域标注且易受分布偏移影响,导致目标域泛化性能下降。为此,本文提出一种自监督跨域迁移框架,无需源域标签即可学习可迁移的光谱-空间联合表征,并在目标域少样本条件下实现高效适应。预训练阶段设计了空间-光谱变换器(S2Former)模块,采用双分支结构和双向交叉注意力机制,实现光谱-空间协同建模:空间分支通过随机掩码增强结构感知,光谱分支捕捉细微差异,两分支相互引导以提升语义一致性。进一步提出频域约束(FDC),利用真实快速傅里叶变换(rFFT)与高频幅值损失保持频域一致性,增强对细节与边界的分辨能力。微调阶段引入扩散对齐微调(DAFT)蒸馏机制,通过教师-学生结构对齐语义演化轨迹,在低标签条件下实现鲁棒迁移学习。实验结果表明,该方法在四个高光谱数据集上均表现出稳定的分类性能与强跨域适应性,验证了其在资源受限条件下的有效性。
原文摘要 · Abstract (English)
Self-supervised learning has demonstrated considerable potential in hyperspectral representation, yet its application in cross-domain transfer scenarios remains under-explored. Existing methods, however, still rely on source domain annotations and are susceptible to distribution shifts, leading to degraded generalization performance in the target domain. To address this, this paper proposes a self-supervised cross-domain transfer framework that learns transferable spectral-spatial joint representations without source labels and achieves efficient adaptation under few samples in the target domain. During the self-supervised pre-training phase, a Spatial-Spectral Transformer (S2Former) module is designed. It adopts a dual-branch spatial-spectral transformer and introduces a bidirectional cross-attention mechanism to achieve spectral-spatial collaborative modeling: the spatial branch enhances structural awareness through random masking, while the spectral branch captures fine-grained differences. Both branches mutually guide each other to improve semantic consistency. We further propose a Frequency Domain Constraint (FDC) to maintain frequency-domain consistency through real Fast Fourier Transform (rFFT) and high-frequency magnitude loss, thereby enhancing the model's capability to discern fine details and boundaries. During the fine-tuning phase, we introduce a Diffusion-Aligned Fine-tuning (DAFT) distillation mechanism. This aligns semantic evolution trajectories through a teacher-student structure, enabling robust transfer learning under low-label conditions. Experimental results demonstrate stable classification performance and strong cross-domain adaptability across four hyperspectral datasets, validating the method's effectiveness under resource-constrained conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。