提出融合光谱与空间交互的高光谱目标跟踪方法,提升小目标和复杂背景下的追踪精度。
SUIT: Spatial-Spectral Union-Intersection Interaction Network for Hyperspectral Object Tracking
- 用Transformer建模跨波段长程空间关系,结合集合论的并交原理整合光谱交互
- 在12个数据集上平均精度达73.6%,超越现有方法,在小目标场景提升显著
- 适合需要高光谱信息融合的遥感、工业检测等应用,尤其对形变与外观变化鲁棒
高光谱视频(HSVs)因其固有的空间-光谱-时间结构,在杂乱背景和小目标等挑战性场景中具有显著优势。然而,现有方法主要关注模板与搜索区域间的空间交互,常忽略光谱交互,导致性能受限。本文从架构和训练两方面研究光谱交互:在架构层面,首先使用Transformer建立模板与搜索区域间波段级的长程空间关系,再通过集合论中的包含-排除原理,将光谱交互建模为所有波段空间交互的并集,实现共享与波段特有空间线索的有效融合;在训练层面,引入光谱损失函数,强制模板与预测区域间的物质分布对齐,增强对形状形变和外观变化的鲁棒性。大量实验表明,该追踪器达到当前最优性能。源代码、训练模型与结果将通过https://github.com/bearshng/suit公开,以支持可复现性。
原文摘要 · Abstract (English)
Hyperspectral videos (HSVs), with their inherent spatial-spectral-temporal structure, offer distinct advantages in challenging tracking scenarios such as cluttered backgrounds and small objects. However, existing methods primarily focus on spatial interactions between the template and search regions, often overlooking spectral interactions, leading to suboptimal performance. To address this issue, this paper investigates spectral interactions from both the architectural and training perspectives. At the architectural level, we first establish band-wise long-range spatial relationships between the template and search regions using Transformers. We then model spectral interactions using the inclusion-exclusion principle from set theory, treating them as the union of spatial interactions across all bands. This enables the effective integration of both shared and band-specific spatial cues. At the training level, we introduce a spectral loss to enforce material distribution alignment between the template and predicted regions, enhancing robustness to shape deformation and appearance variations. Extensive experiments demonstrate that our tracker achieves state-of-the-art tracking performance. The source code, trained models and results will be publicly available via https://github.com/bearshng/suit to support reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。