arXiv:2509.08265cs.CV2025-09被引 3

用Mamba模型统一建模光谱、深度和时序信息,提升高光谱目标跟踪精度。

Hyperspectral Mamba for Hyperspectral Object Tracking

  • 通过状态空间模块融合光谱、跨深度与时间信息
  • 在HOTC2020上达到73.0% AUC和96.3% DP@20
  • 适合高光谱图像中复杂场景的目标跟踪任务

高光谱目标跟踪因其丰富的光谱信息和精细的物质区分能力,在复杂场景中具有巨大潜力。现有方法虽通过伪彩色转换或模态融合取得进展,但仍难以捕捉内在光谱特征、时序依赖及跨深度交互。为此,本文提出基于Mamba的高光谱目标跟踪网络HyMamba,通过状态空间模块(SSMs)统一建模光谱、跨深度与时间关系。核心为光谱状态融合(SSI)模块,实现光谱特征在深度与时间维度上的渐进式优化与传播。每个SSI内嵌高光谱Mamba(HSM)模块,利用三向扫描状态空间模块同步学习空间与光谱信息。结合伪彩色与高光谱输入构建联合特征,并与原始高光谱特征交互增强。在七个基准数据集上的实验表明,HyMamba表现领先,例如在HOTC2020上达到73.0% AUC和96.3% DP@20。代码将开源于https://github.com/lgao001/HyMamba。

原文摘要 · Abstract (English)

Hyperspectral object tracking holds great promise due to the rich spectral information and fine-grained material distinctions in hyperspectral images, which are beneficial in challenging scenarios. While existing hyperspectral trackers have made progress by either transforming hyperspectral data into false-color images or incorporating modality fusion strategies, they often fail to capture the intrinsic spectral information, temporal dependencies, and cross-depth interactions. To address these limitations, a new hyperspectral object tracking network equipped with Mamba (HyMamba), is proposed. It unifies spectral, cross-depth, and temporal modeling through state space modules (SSMs). The core of HyMamba lies in the Spectral State Integration (SSI) module, which enables progressive refinement and propagation of spectral features with cross-depth and temporal spectral information. Embedded within each SSI, the Hyperspectral Mamba (HSM) module is introduced to learn spatial and spectral information synchronously via three directional scanning SSMs. Based on SSI and HSM, HyMamba constructs joint features from false-color and hyperspectral inputs, and enhances them through interaction with original spectral features extracted from raw hyperspectral images. Extensive experiments conducted on seven benchmark datasets demonstrate that HyMamba achieves state-of-the-art performance. For instance, it achieves 73.0\% of the AUC score and 96.3\% of the DP@20 score on the HOTC2020 dataset. The code will be released at https://github.com/lgao001/HyMamba.

高光谱目标跟踪Mamba状态空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。