arXiv:2510.06619cs.CV2025-10被引 2

构建首个大规模多光谱单目标跟踪数据集,提升复杂场景追踪性能。

MSITrack: A Challenging Benchmark for Multispectral Single Object Tracking

  • 基于多光谱影像增强目标区分度,缓解遮挡与背景干扰。
  • 包含300段视频、超129,000帧,覆盖55类物体和300个自然场景。
  • 专为真实复杂环境设计,适合研究多光谱视觉追踪的团队使用。

现实场景中的视觉目标追踪面临遮挡、相似物体干扰及复杂背景等挑战,限制了仅依赖RGB图像的追踪器性能。多光谱成像通过捕捉像素级光谱反射特性,可显著提升目标区分能力。然而,现有支持多光谱追踪的数据集仍十分有限。为此,我们提出了目前规模最大、多样性最高的多光谱单目标追踪数据集MSITrack。其核心特点包括:(i) 更具挑战性的属性——涵盖自然场景中目标与背景在颜色、纹理上的相似性,以及来自相似物体的干扰;(ii) 更丰富自然的场景——涵盖55类物体和300个独立自然场景,多数为首次引入多光谱追踪领域;(iii) 更大规模——共300段视频,超过129,000帧多光谱图像。为保证标注精度,每帧均经过精细处理、人工标注与多阶段验证。代表性追踪器的广泛评估表明,多光谱数据在MSITrack上显著优于仅使用RGB的基线模型,凸显其推动该领域发展的潜力。数据集已公开于:https://github.com/Fengtao191/MSITrack。

原文摘要 · Abstract (English)

Visual object tracking in real-world scenarios presents numerous challenges including occlusion, interference from similar objects and complex backgrounds-all of which limit the effectiveness of RGB-based trackers. Multispectral imagery, which captures pixel-level spectral reflectance, enhances target discriminability. However, the availability of multispectral tracking datasets remains limited. To bridge this gap, we introduce MSITrack, the largest and most diverse multispectral single object tracking dataset to date. MSITrack offers the following key features: (i) More Challenging Attributes-including interference from similar objects and similarity in color and texture between targets and backgrounds in natural scenarios, along with a wide range of real-world tracking challenges; (ii) Richer and More Natural Scenes-spanning 55 object categories and 300 distinct natural scenes, MSITrack far exceeds the scope of existing benchmarks. Many of these scenes and categories are introduced to the multispectral tracking domain for the first time; (iii) Larger Scale-300 videos comprising over 129k frames of multispectral imagery. To ensure annotation precision, each frame has undergone meticulous processing, manual labeling and multi-stage verification. Extensive evaluations using representative trackers demonstrate that the multispectral data in MSITrack significantly improves performance over RGB-only baselines, highlighting its potential to drive future advancements in the field. The MSITrack dataset is publicly available at: https://github.com/Fengtao191/MSITrack.

多光谱追踪数据集目标跟踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。