arXiv:2503.17699cs.CV2025-03CVPR被引 24

首个多光谱无人机目标跟踪数据集与统一框架,提升小目标追踪精度。

MUST: The First Dataset and Unified Framework for Multispectral UAV Single Object Tracking

  • 提出UNTrack框架,融合光谱、空间与时间特征进行追踪
  • 在250个视频序列上超越现有最优无人机追踪方法
  • 适合多光谱视觉、无人机追踪研究者使用

无人机目标追踪在真实场景中面临小目标、遮挡等挑战,限制了基于RGB的追踪器性能。多光谱图像(MSI)通过捕获额外光谱信息,为解决这些问题提供了新途径。然而,该领域进展受限于缺乏相关数据集。为此,我们发布了首个大规模多光谱无人机单目标追踪数据集MUST,包含250个视频序列,覆盖多样环境与挑战,为多光谱无人机追踪提供全面数据基础。同时提出新型追踪框架UNTrack,从光谱提示、初始模板和序列搜索中编码统一的光谱、空间与时间特征。UNTrack采用非对称变压器结合光谱背景消除机制以优化关系建模,并设计持续更新光谱提示的编码器以提升追踪精度与效率。大量实验表明,所提UNTrack优于当前最先进无人机追踪算法。我们认为该数据集与框架将推动该领域未来发展。数据集可访问:https://github.com/q2479036243/MUST-Multispectral-UAV-Single-Object-Tracking。

原文摘要 · Abstract (English)

UAV tracking faces significant challenges in real-world scenarios, such as small-size targets and occlusions, which limit the performance of RGB-based trackers. Multispectral images (MSI), which capture additional spectral information, offer a promising solution to these challenges. However, progress in this field has been hindered by the lack of relevant datasets. To address this gap, we introduce the first large-scale Multispectral UAV Single Object Tracking dataset (MUST), which includes 250 video sequences spanning diverse environments and challenges, providing a comprehensive data foundation for multispectral UAV tracking. We also propose a novel tracking framework, UNTrack, which encodes unified spectral, spatial, and temporal features from spectrum prompts, initial templates, and sequential searches. UNTrack employs an asymmetric transformer with a spectral background eliminate mechanism for optimal relationship modeling and an encoder that continuously updates the spectrum prompt to refine tracking, improving both accuracy and efficiency. Extensive experiments show that our proposed UNTrack outperforms state-of-the-art UAV trackers. We believe our dataset and framework will drive future research in this area. The dataset is available on https://github.com/q2479036243/MUST-Multispectral-UAV-Single-Object-Tracking.

多光谱无人机追踪目标追踪数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。