arXiv:2507.02268cs.CVeess.IV2025-07被引 51

解决遥感影像跨域分类中的光谱偏移问题,提升模型泛化能力。

Cross-domain Hyperspectral Image Classification based on Bi-directional Domain Adaptation

  • 设计双向自适应框架,分别学习源域与目标域的特征空间。
  • 在跨时相树种分类任务中,性能优于先进方法3%~5%。
  • 适合处理不同时间/场景下遥感图像的分类任务。

高光谱遥感技术可提取细粒度地物类别。通常训练与测试数据来自不同区域或时段,同一类地物在不同场景中存在显著光谱偏移。本文提出双向域适应(BiDA)框架,旨在独立自适应空间中同时提取域不变特征与域特定信息,增强模型对目标场景的适应性与可分性。BiDA采用三分支变换器架构(源分支、目标分支、耦合分支),结合语义标记器。源分支与目标分支分别学习各自域的自适应空间,耦合分支引入耦合多头交叉注意力(CMCA)机制,实现特征交互与域间相关性挖掘。进一步设计双向知识蒸馏损失,利用域间相关性指导自适应空间学习。此外,提出自适应强化策略(ARS),在噪声条件下引导模型聚焦于通用特征提取。在跨时相/场景的机载与卫星数据集上实验表明,所提BiDA显著优于现有先进域适应方法。在跨时相树种分类任务中,性能较最先进方法提升3%~5%。代码将发布于:https://github.com/YuxiangZhang-BIT/IEEE_TCSVT_BiDA。

原文摘要 · Abstract (English)

Utilizing hyperspectral remote sensing technology enables the extraction of fine-grained land cover classes. Typically, satellite or airborne images used for training and testing are acquired from different regions or times, where the same class has significant spectral shifts in different scenes. In this paper, we propose a Bi-directional Domain Adaptation (BiDA) framework for cross-domain hyperspectral image (HSI) classification, which focuses on extracting both domain-invariant features and domain-specific information in the independent adaptive space, thereby enhancing the adaptability and separability to the target scene. In the proposed BiDA, a triple-branch transformer architecture (the source branch, target branch, and coupled branch) with semantic tokenizer is designed as the backbone. Specifically, the source branch and target branch independently learn the adaptive space of source and target domains, a Coupled Multi-head Cross-attention (CMCA) mechanism is developed in coupled branch for feature interaction and inter-domain correlation mining. Furthermore, a bi-directional distillation loss is designed to guide adaptive space learning using inter-domain correlation. Finally, we propose an Adaptive Reinforcement Strategy (ARS) to encourage the model to focus on specific generalized feature extraction within both source and target scenes in noise condition. Experimental results on cross-temporal/scene airborne and satellite datasets demonstrate that the proposed BiDA performs significantly better than some state-of-the-art domain adaptation approaches. In the cross-temporal tree species classification task, the proposed BiDA is more than 3\%$\sim$5\% higher than the most advanced method. The codes will be available from the website: https://github.com/YuxiangZhang-BIT/IEEE_TCSVT_BiDA.

高光谱图像域适应遥感分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。