基于流形引导的光谱提示网络,提升跨传感器高光谱目标跟踪性能
MSP-Net: Manifold-Guided Spectral Prompt Network for Hyperspectral Object Tracking

- 通过图驱动流形路由动态构建光谱分组,自适应融合多光谱信息
- 在HOT2020和HOT2023上实现AUC>0.80、精度>0.96,跨传感器鲁棒性强
- 适用于复杂场景下目标形变与背景干扰严重的高光谱跟踪任务
高光谱目标跟踪利用丰富的光谱信息,在复杂场景中具备独特的目标区分能力。然而,现有方法通常将高光谱图像视为RGB图像的多通道扩展,按固定波段顺序进行特征融合,导致模型依赖特定传感器配置,忽略波段间的流形关系,难以泛化至异构传感器。此外,波段的判别性随目标属性和场景变化而动态演变,静态融合策略进一步限制了表征能力。为此,我们提出流形引导的光谱提示网络(MSP-Net)。该网络首先通过图驱动的流形路由重构波段关系并形成自适应光谱分组,再联合分组后的光谱统计量与模板外观,构建与目标相关的动态条件提示,增强目标特征并抑制背景干扰。同时,随着跟踪进程推进,基于中间目标表示持续演化光谱条件,使目标提示能实时适应外观与场景变化。此外,利用可靠的历史状态约束目标定位与尺度波动,显著提升跨传感器跟踪的时序稳定性。在HOT2020和HOT2023上的实验表明,MSP-Net在AUC和精度上均超过0.80和0.96,展现出对异构传感器、目标形变和复杂背景的优异鲁棒性。
原文摘要 · Abstract (English)
Hyperspectral object tracking leverages abundant spectral information to provide unique advantages for target discrimination in complex scenes. However, existing methods typically treat hyperspectral images as multi-channel extensions of RGB images, performing feature fusion in fixed band order. This approach leads to models dependent on specific sensor configurations while neglecting manifold relationships between bands, making generalization to heterogeneous sensors difficult. Moreover, the discriminative contribution of bands dynamically changes with target attributes and scene variations, further limiting the representational capacity of static fusion strategies. To address this, we propose the Manifold-Guided Spectral Prompt Network (MSP-Net). This network first reconstructs band relationships and forms adaptive spectral grouping through graph-driven manifold routing, then jointly integrates grouped spectral statistics with template appearance to construct target-related dynamic conditional prompts, enhancing target features while suppressing background interference. Furthermore, as tracking progresses, spectral conditions continuously evolve based on intermediate target representations, enabling target prompts to adapt in real-time to appearance and scene changes. Meanwhile, reliable historical states are used to constrain target localization and scale fluctuations, significantly improving temporal stability in cross-sensor tracking. Experiments on HOT2020 and HOT2023 demonstrate that MSP-Net achieves AUC and Precision exceeding 0.80 and 0.96, respectively, exhibiting exceptional robustness under heterogeneous sensors, target deformation, and complex background conditions. The code will be released at https://github.com/GGML668897/MSP-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。