arXiv:2605.20569cs.CV2026-05被引 1

端到端联合解混与追踪,提升高光谱目标定位精度。

End-to-End Unmixing with Material Prompts for Hyperspectral Object Tracking

论文配图:End-to-End Unmixing with Material Prompts for Hyperspectral Object Tracking
图 1 · 摘自论文原文
  • 通过加权目标导向的解混损失,联合优化材质分解与目标定位。
  • 在标准数据集上达到当前最佳性能,显著提升复杂场景追踪效果。
  • 适合需要高光谱材质信息的视觉追踪研究者使用。

高光谱图像包含丰富的材料属性,可增强在外观模糊、光照变化和背景干扰下的追踪鲁棒性。然而,由于高光谱视频数据稀缺,现有方法多通过空间或通道融合策略适配预训练的RGB追踪器,忽视了高光谱图像中固有的材料信息。少数材料感知方法依赖外部解混流程,与追踪目标解耦,难以有效优化材料表示。为此,本文将高光谱目标追踪建模为材质分解与目标定位的联合优化问题,通过加权目标导向解混损失将两者耦合,显式对齐材质表示与定位精度。提出一种基于自适应频率分解的深度学习材质分解模块;在此基础上,引入双分支小波增强材质提示模块,通过频域中的高效空间-材质交互学习低频与高频材质提示。该框架具备模型无关性,可无缝集成不同解混主干网络。在多个标准高光谱追踪基准上的实验表明,所提方法实现最先进性能,验证了端到端材料感知追踪框架的有效性。代码已开源:https://github.com/han030927/E2EMPT。

原文摘要 · Abstract (English)

Hyperspectral imagery encodes rich material properties that can improve tracking robustness under appearance ambiguity, illumination change, and background clutter. However, due to the limited availability of hyperspectral video data, many existing methods adapt pretrained RGB trackers via spatial or channel fusion strategies, largely neglecting the intrinsic material information in hyperspectral imagery. Moreover, the few material-aware approaches typically rely on external spectral unmixing pipelines that are decoupled from the tracking objective, limiting effective optimization of material representations for target localization. To address these limitations, we formulate hyperspectral object tracking as a joint optimization problem of material decomposition and target localization, coupling the two tasks via a weighted target-oriented unmixing loss that explicitly aligns material representations with localization accuracy. Specifically, we propose a material representation decomposition module for deep learning-based spectral unmixing with adaptive frequency decomposition. Building on the decomposed material representations, we further introduce a dual-branch wavelet-enhanced material prompt module that learns low- and high-frequency material prompts through efficient spatial-material interactions in the frequency domain. The framework is model-agnostic and can be seamlessly generalized to different unmixing backbones. Extensive experiments on standard hyperspectral tracking benchmarks demonstrate state-of-the-art performance and validate the effectiveness of the proposed end-to-end material-aware tracking framework. Code is available at https://github.com/han030927/E2EMPT.

高光谱追踪材质解混端到端小波提示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。