arXiv:2410.20421cs.CVcs.AI2024-10中稿 · ance at the Asian …被引 6

首个大规模夜间视觉目标跟踪基准,解决夜间追踪难题。

NT-VOT211: A Large-Scale Benchmark for Night-time Visual Object Tracking

  • 构建211个夜间视频数据集,含21.1万标注帧
  • 覆盖8类挑战:运动模糊、小目标、遮挡等
  • 适合研究夜间视觉追踪算法的开发者使用

现有视觉目标跟踪基准如OTB100、NfS、UAV123、LaSOT和GOT-10K主要聚焦日间场景,对夜间挑战研究不足,主因是缺乏大规模、高质量的夜间标注数据集。为此,本文提出NT-VOT211,首个专为夜间视觉目标跟踪设计的大规模基准。该数据集包含211段多样视频,共211,000帧精细标注,涵盖相机运动、形变、快速运动、运动模糊、小目标、干扰物、遮挡和出视野等8种属性。据我们所知,这是迄今最大且专为夜间环境设计的追踪基准,可有效评估算法在低光照、图像模糊及干扰物等复杂条件下的表现。通过对42种不同追踪算法在该基准上的全面分析,揭示了现有方法的优势与局限,指明提升方向。同时公开排行榜、标注工具、元信息及全部代码,确保结果可复现。我们相信该基准将推动视觉目标跟踪算法在真实夜间场景中的应用与改进。

原文摘要 · Abstract (English)

Many current visual object tracking benchmarks such as OTB100, NfS, UAV123, LaSOT, and GOT-10K, predominantly contain day-time scenarios while the challenges posed by the night-time has been less investigated. It is primarily because of the lack of a large-scale, well-annotated night-time benchmark for rigorously evaluating tracking algorithms. To this end, this paper presents NT-VOT211, a new benchmark tailored for evaluating visual object tracking algorithms in the challenging night-time conditions. NT-VOT211 consists of 211 diverse videos, offering 211,000 well-annotated frames with 8 attributes including camera motion, deformation, fast motion, motion blur, tiny target, distractors, occlusion and out-of-view. To the best of our knowledge, it is the largest night-time tracking benchmark to-date that is specifically designed to address unique challenges such as adverse visibility, image blur, and distractors inherent to night-time tracking scenarios. Through a comprehensive analysis of results obtained from 42 diverse tracking algorithms on NT-VOT211, we uncover the strengths and limitations of these algorithms, highlighting opportunities for enhancements in visual object tracking, particularly in environments with suboptimal lighting. Besides, a leaderboard for revealing performance rankings, annotation tools, comprehensive meta-information and all the necessary code for reproducibility of results is made publicly available. We believe that our NT-VOT211 benchmark will not only be instrumental in facilitating field deployment of VOT algorithms, but will also help VOT enhancements and it will unlock new real-world tracking applications. Our dataset and other assets can be found at: {https://github.com/LiuYuML/NV-VOT211.

目标跟踪夜间追踪数据集视觉感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。