arXiv:2607.19772cs.CV2026-07

构建首个大规模动态多模态跟踪基准,支持真实场景下跨平台、跨模态追踪评估。

DRGBT-1K: A Large-scale High-quality Benchmark for Dynamic RGBT Tracking

论文配图:DRGBT-1K: A Large-scale High-quality Benchmark for Dynamic RGBT Tracking
图 1 · 摘自论文原文
  • 构建包含1045段真实场景序列的大型动态RGBT跟踪数据集。
  • 覆盖24类目标、15种挑战属性,提供细粒度标注与统一评估协议。
  • 适合研究无人机-地面协同感知、跨模态缺失等前沿跟踪问题者使用。

动态多模态(DRGBT)跟踪旨在传感器模态与观测平台随时间变化时持续定位目标。相较于固定输入与平台的传统RGBT跟踪,其更贴近真实协同感知系统中异构传感器从不同视角观测目标的场景。然而现有基准难以系统评估跟踪器在真实动态模态变化与跨平台切换下的鲁棒性。为此,本文提出DRGBT-1K,一个大规模高质量基准:包含1,045个真实场景序列和79.5万对RGBT帧,由无人机与手持设备采集,涵盖多样化场景、显著视角变化、模态差异及目标外观不连续;提供精细标注,包括密集边界框、类别标签、挑战属性、帧级模态与平台标签,覆盖24类目标、15种以上场景类型与15项挑战属性;基于统一评估协议,评测20种代表性多模态跟踪方法,含传统RGBT、模态缺失型与动态跟踪器;同时发布非对齐版本,衍生出UGVT-1K,支持非对齐多模态与无人机-地面协同跟踪研究;并开发在线评测平台与排行榜,持续收录新方法。

原文摘要 · Abstract (English)

Dynamic RGBT (DRGBT) tracking aims to continuously localize a target when the available sensing modalities and observation platforms vary over time. Compared with conventional RGBT tracking with fixed RGBT inputs and a fixed observation platform, DRGBT tracking is more consistent with real-world collaborative perception systems, where targets may be observed by heterogeneous sensors from different viewpoints. However, existing benchmarks are still insufficient for systematically evaluating tracker robustness under real dynamic modality variations and cross-platform transitions. To address this limitation, we make the following contributions. 1) We construct DRGBT-1K, a large-scale high-quality benchmark for DRGBT tracking. It contains 1,045 sequences captured entirely in real-world scenarios and 795K RGBT frame pairs collected using UAVs and handheld RGBT devices, encompassing diverse real-world scenes, pronounced viewpoint changes, modality variations, and target appearance discontinuities. 2) We provide comprehensive annotations for fine-grained evaluation, including dense bounding boxes, target category labels, challenge attributes, frame-level modality labels and platform labels. DRGBT-1K covers 24 target categories, more than 15 scene types and 15 challenge attributes. 3) We establish a comprehensive benchmark by evaluating 20 representative multimodal tracking methods, including conventional RGBT trackers, modality-missing RGBT trackers, and DRGBT trackers under a unified evaluation protocol. 4) We release an unaligned version of DRGBT-1K and derive UGVT-1K to support broader research on unaligned multimodal tracking and UAV-ground collaborative tracking. 5) We develop an online evaluation platform for DRGBT-1K and provide a leaderboard that collects all methods evaluated on this benchmark.

多模态跟踪无人机协同真实场景动态模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。