arXiv:2509.08436cs.CV2025-09被引 2

提升高光谱图像分类在真实退化下的鲁棒性,无需源数据或标签。

HyperTTA: Test-Time Adaptation for Hyperspectral Image Classification under Distribution Shifts

  • 构建九类退化模拟的统一评测基准,支持全面评估。
  • 提出SSTC模型与轻量级适配器CELA,实现测试时自适应。
  • 适合高光谱遥感、医学影像等需应对分布偏移场景的研究者。

高光谱图像(HSI)分类模型易受噪声、模糊、压缩和大气效应等真实退化引起的分布偏移影响。为此,我们提出HyperTTA(面向高光谱退化的测试时可适配变压器),一种统一框架以增强模型在多种退化条件下的鲁棒性。首先,构建一个包含九种典型退化的多退化高光谱基准,支持对鲁棒分类的全面评估。基于该基准,开发具有多尺度感受野机制和标签平滑正则化的光谱-空间变压器分类器(SSTC),以捕捉多尺度空间上下文并提升泛化能力。此外,提出轻量级测试时适配策略——置信度感知熵最小化层归一化适配器(CELA),通过在高置信度无标签目标样本上最小化预测熵,仅动态更新层归一化层的仿射参数。该策略无需源数据或目标标签即可实现可靠适配。在两个基准数据集上的实验表明,HyperTTA在广泛退化场景下优于现有最先进方法。代码将公开发布。

原文摘要 · Abstract (English)

Hyperspectral image (HSI) classification models are highly sensitive to distribution shifts caused by real-world degradations such as noise, blur, compression, and atmospheric effects. To address this challenge, we propose HyperTTA (Test-Time Adaptable Transformer for Hyperspectral Degradation), a unified framework that enhances model robustness under diverse degradation conditions. First, we construct a multi-degradation hyperspectral benchmark that systematically simulates nine representative degradations, enabling comprehensive evaluation of robust classification. Based on this benchmark, we develop a Spectral--Spatial Transformer Classifier (SSTC) with a multi-level receptive field mechanism and label smoothing regularization to capture multi-scale spatial context and improve generalization. Furthermore, we introduce a lightweight test-time adaptation strategy, the Confidence-aware Entropy-minimized LayerNorm Adapter (CELA), which dynamically updates only the affine parameters of LayerNorm layers by minimizing prediction entropy on high-confidence unlabeled target samples. This strategy ensures reliable adaptation without access to source data or target labels. Experiments on two benchmark datasets demonstrate that HyperTTA outperforms state-of-the-art baselines across a wide range of degradation scenarios. Code will be made available publicly.

高光谱测试时适配遥感鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。