无需源数据,在恶劣天气下实现鲁棒目标追踪
SFDATrack: Generalized Source-Free Domain Adaptive Tracking Under Adverse Weather Conditions

- 利用目标域的恶劣天气样本,通过双交互Mamba结构提取抗干扰特征
- 在超球空间中投影特征,实现多天气场景下的强泛化能力
- 适合资源受限且无源数据的实时追踪应用
恶劣天气下的领域自适应视觉目标追踪近年受到广泛关注。现有方法严重依赖源域与目标域的大规模视频帧,但在源数据不可用的资源受限场景下难以实施。为此,我们提出SFDATrack,一种仅需目标域恶劣天气样本的通用无源域自适应追踪器,以实现稳健的状态估计。具体地,SFDATrack首先采用带双交互Mamba(DIM)模块的均值教师骨干网络,从分类增强样本中蒸馏出对天气变化鲁棒的候选目标标记;随后引入超球原型投影(HPP)模块,将这些标记投影到潜在超球空间中的多领域原型上。通过同时约束多领域原型的领域特异性和领域不变性,SFDATrack可无缝适应多种天气条件,具备强大泛化能力。在多个基准上的大量实验表明,SFDATrack优于当前最先进方法。代码已开源:https://github.com/watcherBR0/sfdatrack。
原文摘要 · Abstract (English)
Domain adaptive visual object tracking under adverse weather conditions has garnered significant attention in recent years. Despite the impressive performance, existing methods heavily rely on the large-scale video frames from both source and target domains, which is impractical under rigid resource constraints where source data is unavailable. To overcome this limitation, we propose SFDATrack, a generalized source-free domain adaptive tracker that merely leverages adverse weather samples from the target domain for robust state estimation. Specifically, SFDATrack first employs a mean-teacher backbone with Dual Interactive Mamba (DIM) blocks to distill the candidate target tokens that are resilient to weather variations from classified, augmented samples. Afterwards, we introduce a hyperspherical prototype projection (HPP) module to project these tokens onto multi-domain prototypes within a latent hyperspherical space. By enforcing both domain-specific and domain-invariant properties of the multi-domain prototypes, SFDATrack can be seamlessly adapted to diverse weather conditions with powerful generalizability. Extensive experiments evaluated on various benchmarks demonstrate that SFDATrack achieves superior performance compared to state-of-the-art approaches. The code is available at https://github.com/watcherBR0/sfdatrack.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。