通过反事实学习提升红外无人机追踪中的运动可靠性。
Counterfactual Motion Reliability Learning for Robust UAV Tracking

- 设计反事实分支,区分真实目标运动与背景伪运动。
- 在Anti-UAV410上优于现有追踪器,显著提升OSTrack性能。
- 适合需要鲁棒性红外追踪的无人机应用场景。
红外无人机追踪面临目标小、对比度低,易被热干扰或复杂背景混淆的挑战。尽管基于Transformer的追踪器通过学习强外观表征取得进展,但在目标外观弱或模糊时,响应仍可能受背景结构影响。引入时间运动线索是自然思路,但红外追踪中运动信号常不可靠:相机抖动、动态背景、传感器噪声及目标消失会导致时间变化强于真实运动。关键难题并非如何使用运动,而是如何识别目标一致的运动而非背景引起的伪运动。为此,本文提出CMRTrack,一种反事实运动可靠性学习框架。该方法通过轻量级运动证据编码器从邻近搜索区域提取时间证据。训练时引入反事实目标擦除历史分支,构建困难的运动参考,促使运动编码器学习可靠的、与目标一致的运动特征,而非任意时间变化。所学运动证据通过运动引导的令牌调制和可靠性感知得分融合,融入单流追踪框架,实现自适应特征增强与响应优化。在Anti-UAV410上的大量实验表明,CMRTrack持续优于现有先进追踪器,显著提升OSTrack基线性能,消融实验与定性分析验证了反事实运动可靠性学习的有效性。
原文摘要 · Abstract (English)
Infrared unmanned aerial vehicle (UAV) tracking is challenging because the target is often small, low-contrast, and easily confused with thermal distractors or cluttered backgrounds. Recent Transformer-based trackers have achieved promising performance by learning strong appearance representations, but their responses can still be dominated by background structures when the target appearance is weak or ambiguous. A natural solution is to introduce temporal motion cues. However, in infrared UAV tracking, motion cues are not always reliable: camera jitter, dynamic backgrounds, sensor noise, and target disappearance may produce temporal variations that are stronger than the true target motion. Therefore, the key challenge is not simply how to use motion, but how to distinguish target-consistent motion from background-induced pseudo motion. To this end, we propose CMRTrack, a counterfactual motion reliability learning framework for robust infrared UAV tracking. CMRTrack first extracts temporal evidence from adjacent search regions using a lightweight motion evidence encoder. During training, a counterfactual target-erased history branch is introduced to construct hard motion references, encouraging the motion encoder to learn reliable target-consistent motion rather than arbitrary temporal changes. The learned motion evidence is then incorporated into a one-stream tracking framework through motion-guided token modulation and reliability-aware score fusion, enabling adaptive feature enhancement and response refinement. Extensive experiments on Anti-UAV410 demonstrate that CMRTrack consistently outperforms representative state-of-the-art trackers and significantly improves the OSTrack baseline, with ablation studies and qualitative analysis verifying the effectiveness of the proposed counterfactual motion reliability learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。