通过解耦语义与光谱动态,实现少样本高光谱目标检测的高效精准适配。
Physics-Aligned Spectral Mamba: Decoupling Semantics and Dynamics for Few-Shot Hyperspectral Target Detection
- 冻结主干网络,用DCT-Mamba适配器捕获频域光谱连续性。
- 在多个数据集上准确率超越当前最优方法,跨域泛化能力显著提升。
- 适合资源受限场景下的少样本高光谱检测,尤其对原型漂移敏感任务有效。
元学习助力少样本高光谱目标检测(HTD),但深度主干的适配仍具挑战。全参数微调效率低且易过拟合,现有方法大多忽略高光谱数据的频域结构与波段连续性,限制了光谱适应性和跨域泛化能力。为此,我们提出SpecMamba,一种参数高效且频率感知的框架,将稳定语义表征与灵活光谱适配解耦。具体而言,在冻结的Transformer表示上引入离散余弦变换马尔可夫适配器(DCTMA)。通过DCT将光谱特征投影至频域,并利用Mamba的线性复杂度状态空间递归,显式捕捉全局光谱依赖与波段连续性,避免全微调冗余。为缓解小样本导致的原型漂移,设计先验引导三编码器(PGTE),使实验室光谱先验指导可学习适配器优化,而不破坏稳定语义空间。最后,提出自监督伪标签映射(SSPLM)策略,实现测试时适配,通过不确定性感知采样与双路径一致性约束,高效优化决策边界。多组公开数据集上的实验表明,SpecMamba在检测精度和跨域泛化方面持续优于当前最优方法。
原文摘要 · Abstract (English)
Meta-learning facilitates few-shot hyperspectral target detection (HTD), but adapting deep backbones remains challenging. Full-parameter fine-tuning is inefficient and prone to overfitting, and existing methods largely ignore the frequency-domain structure and spectral band continuity of hyperspectral data, limiting spectral adaptation and cross-domain generalization.To address these challenges, we propose SpecMamba, a parameter-efficient and frequency-aware framework that decouples stable semantic representation from agile spectral adaptation. Specifically, we introduce a Discrete Cosine Transform Mamba Adapter (DCTMA) on top of frozen Transformer representations. By projecting spectral features into the frequency domain via DCT and leveraging Mamba's linear-complexity state-space recursion, DCTMA explicitly captures global spectral dependencies and band continuity while avoiding the redundancy of full fine-tuning. Furthermore, to address prototype drift caused by limited sample sizes, we design a Prior-Guided Tri-Encoder (PGTE) that allows laboratory spectral priors to guide the optimization of the learnable adapter without disrupting the stable semantic feature space. Finally, a Self-Supervised Pseudo-Label Mapping (SSPLM) strategy is developed for test-time adaptation, enabling efficient decision boundary refinement through uncertainty-aware sampling and dual-path consistency constraints. Extensive experiments on multiple public datasets demonstrate that SpecMamba consistently outperforms state-of-the-art methods in detection accuracy and cross-domain generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。