在恶劣天气下实现统一自适应目标跟踪,性能显著超越现有方法。
UMDATrack: Unified Multi-Domain Adaptive Tracking Under Adverse Weather Conditions
- 用文本引导生成少量合成天气视频,低成本构建多域数据。
- 设计定制化适配器,快速适应不同天气,无需大量重训练。
- 通过目标感知置信度对齐提升跨域定位一致性,适合实际部署。
视觉目标跟踪在过去几十年取得了显著进展,但大多数方法集中在白天正常条件下的目标表征学习。而在真实世界中,夜间或雾天等恶劣天气导致巨大领域偏移,使性能严重下降。本文提出UMDATrack,可在统一领域自适应框架下,有效应对多种恶劣天气并保持高质量的目标状态预测。首先,利用可控场景生成器,在文本提示引导下合成少量未标注视频(源白天数据集帧数少于2%),覆盖多种天气条件。随后,设计简单有效的领域定制适配器(DCA),使目标表征能快速适应各类天气,无需冗余模型更新。此外,为增强源域与目标域间的定位一致性,提出基于最优传输理论的目标感知置信度对齐模块(TCA)。大量实验表明,UMDATrack显著超越现有先进追踪器,达到新的最先进水平。代码已公开于https://github.com/Z-Z188/UMDATrack。
原文摘要 · Abstract (English)
Visual object tracking has gained promising progress in past decades. Most of the existing approaches focus on learning target representation in well-conditioned daytime data, while for the unconstrained real-world scenarios with adverse weather conditions, e.g. nighttime or foggy environment, the tremendous domain shift leads to significant performance degradation. In this paper, we propose UMDATrack, which is capable of maintaining high-quality target state prediction under various adverse weather conditions within a unified domain adaptation framework. Specifically, we first use a controllable scenario generator to synthesize a small amount of unlabeled videos (less than 2% frames in source daytime datasets) in multiple weather conditions under the guidance of different text prompts. Afterwards, we design a simple yet effective domain-customized adapter (DCA), allowing the target objects' representation to rapidly adapt to various weather conditions without redundant model updating. Furthermore, to enhance the localization consistency between source and target domains, we propose a target-aware confidence alignment module (TCA) following optimal transport theorem. Extensive experiments demonstrate that UMDATrack can surpass existing advanced visual trackers and lead new state-of-the-art performance by a significant margin. Our code is available at https://github.com/Z-Z188/UMDATrack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。