arXiv:2409.18533cs.CV2024-09中稿 · IROS2024被引 12

通过提示驱动的时序域适应提升夜间无人机追踪性能

Prompt-Driven Temporal Domain Adaptation for Nighttime UAV Tracking

  • 用提示驱动机制挖掘未标注视频中的目标,生成高质量训练样本
  • 通过时序一致性判别器对齐昼夜时序特征分布,减少时间上下文差异
  • 构建首个长时夜间无人机追踪基准,实测验证实用性和鲁棒性

在低光照条件下,基于域自适应(DA)的夜间无人机追踪已取得显著进展。然而,以往基于训练的域自适应方法在缩小无人机追踪中昼夜时序上下文差异方面仍存在不足。为此,本文提出一种提示驱动的时序域适应训练框架(TDA),充分挖掘时序上下文信息以应对挑战性的夜间无人机追踪任务。具体而言,该框架通过训练时序特征生成器与判别器,对齐昼夜域间的时序特征分布;时序一致性判别器逐步提取共享的域特定特征,生成时序序列中一致的域判别结果。此外,为获取高质量训练样本,引入提示驱动的目标挖掘模块,精确定位未标注夜间视频中的目标。同时,构建了一个新的长时夜间无人机追踪基准。在公开及自建夜间基准上的大量实验表明,采用TDA框架训练的追踪器TDA-Track表现优异;真实场景夜间测试也验证了其实用性。代码与演示视频已在GitHub发布。

原文摘要 · Abstract (English)

Nighttime UAV tracking under low-illuminated scenarios has achieved great progress by domain adaptation (DA). However, previous DA training-based works are deficient in narrowing the discrepancy of temporal contexts for UAV trackers. To address the issue, this work proposes a prompt-driven temporal domain adaptation training framework to fully utilize temporal contexts for challenging nighttime UAV tracking, i.e., TDA. Specifically, the proposed framework aligns the distribution of temporal contexts from daytime and nighttime domains by training the temporal feature generator against the discriminator. The temporal-consistent discriminator progressively extracts shared domain-specific features to generate coherent domain discrimination results in the time series. Additionally, to obtain high-quality training samples, a prompt-driven object miner is employed to precisely locate objects in unannotated nighttime videos. Moreover, a new benchmark for long-term nighttime UAV tracking is constructed. Exhaustive evaluations on both public and self-constructed nighttime benchmarks demonstrate the remarkable performance of the tracker trained in TDA framework, i.e., TDA-Track. Real-world tests at nighttime also show its practicality. The code and demo videos are available at https://github.com/vision4robotics/TDA-Track.

无人机追踪时序域适应夜间视觉提示学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。