arXiv:2608.10485cs.RO2026-08

解决无人机视角抖动下的多目标跟踪难题,实现稳定实时追踪。

JitTrack: Onboard Multi-Object Tracking Against Viewpoint Jitter for Agile UAVs

论文配图:JitTrack: Onboard Multi-Object Tracking Against Viewpoint Jitter for Agile UAVs
图 1 · 摘自论文原文
  • 基于查询的变压器跟踪器,动态修正目标位置偏移
  • 在公开数据集上相比基线提升12.3% MOTA,真实飞行中零丢失
  • 适合需要抗晃动、实时追踪的无人机视觉系统

在敏捷无人机上进行多目标跟踪(MOT)仍面临严重视角抖动挑战,由相机自身运动引起的目标跨帧大幅位移导致关联错误和性能下降。现有方法多在离线基准上评估,很少考虑实际机载部署需求,如对相机运动的鲁棒性及主动目标跟随能力。为此,我们提出JitTrack,一个适应无人机动力学与相机自运动的主动机载多目标跟踪框架。基于查询的变压器跟踪器,引入语义精炼以提升新出现目标检测,采用运动感知查询校正补偿视角抖动带来的目标错位,并设计运动启发的去噪训练策略,模拟相机运动模式实现鲁棒监督。此外,构建感知-规划-控制闭环跟踪流水线,支持敏捷无人机实现无碰撞、物理可行的目标跟随。在公开无人机MOT基准上的大量实验显示,相比基线方法持续提升;真实飞行实验验证了其在视角抖动下鲁棒机载视觉跟踪的有效性与实用性。

原文摘要 · Abstract (English)

Multi-object tracking (MOT) onboard agile unmanned aerial vehicles (UAVs) remains challenging due to severe viewpoint jitter induced by camera ego-motion. Rapid attitude changes during flight often lead to significant target displacement across frames, causing inaccurate target association and degraded tracking performance. Existing UAV MOT methods are primarily evaluated on offline benchmarks and seldom address the practical requirements of real-world onboard deployment, including robustness to camera motion and active target following. To address these challenges, we propose JitTrack, an active onboard multi-object tracking framework that accommodates drone dynamics and camera ego-motion. Built upon a query-based transformer tracker, JitTrack introduces semantic refinement to improve the detection of emerging targets, motion-aware query rectification to compensate for target misalignment caused by viewpoint jitter, and a motion-inspired denoising training strategy that simulates camera motion patterns for robust supervision. Furthermore, we develop a perception-planning-control closed-loop tracking pipeline for real-world deployment, enabling collision-free and physically feasible target following on agile UAVs. Extensive experiments on public UAV MOT benchmarks demonstrate consistent improvements over the baseline method, while real-world flight experiments validate the effectiveness and practicality of JitTrack for robust onboard visual tracking under viewpoint jitter.

多目标跟踪无人机视觉追踪实时系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。