提出可应对遮挡的实时目标跟踪系统,提升复杂环境下的追踪稳定性。
Instance-level Visual Active Tracking with Occlusion-Aware Planning

- 基于DINOv3构建实例级特征原型,避免相似干扰物混淆
- 在线增强原型并结合置信度卡尔曼滤波,稳定应对外观与运动变化
- 通过条件扩散生成避障路径,实现遮挡后的智能恢复跟踪
视觉主动跟踪(VAT)旨在控制摄像头在三维空间中跟随目标,对无人机导航和安防监控至关重要。但实际部署面临两大瓶颈:因缺乏实例级区分导致的相似干扰物混淆,以及因缺少主动规划造成的遮挡严重失效。为此,我们提出统一框架OA-VAT,包含三个互补模块:首先,训练无关的离线实例感知原型初始化,利用DINOv3聚合多视角增强特征构建判别性实例原型,缓解干扰物混淆;其次,在线原型增强跟踪器动态优化原型,并融合置信度感知卡尔曼滤波,提升外观与运动变化下的稳定性;第三,基于自建Planning-20k数据集训练的遮挡感知轨迹规划器,采用条件扩散生成避障路径以实现遮挡恢复。实验表明,OA-VAT在UnrealCV上平均成功率达0.93(比SOTA TrackVLA高2.2%),在真实数据集上平均连续追踪准确率达90.8%(比SOTA GC-VAT高12.1%),在DJI Tello无人机上实现81.6%的追踪成功率。在RTX 3090上运行速度达35 FPS,具备实用部署所需的鲁棒性与实时性。
原文摘要 · Abstract (English)
Visual Active Tracking (VAT) aims to control cameras to follow a target in 3D space, which is critical for applications like drone navigation and security surveillance. However, it faces two key bottlenecks in real-world deployment: confusion from visually similar distractors caused by insufficient instance-level discrimination and severe failure under occlusions due to the absence of active planning. To address these, we propose OA-VAT, a unified pipeline with three complementary modules. First, a training-free Instance-Aware Offline Prototype Initialization aggregates multi-view augmented features via DINOv3 to construct discriminative instance prototypes, mitigating distractor confusion. Second, an Online Prototype Enhancement Tracker enhances prototypes online and integrates a confidence-aware Kalman filter for stable tracking under appearance and motion changes. Third, an Occlusion-Aware Trajectory Planner, trained on our new Planning-20k dataset, uses conditional diffusion to generate obstacle-avoiding paths for occlusion recovery. Experiments demonstrate OA-VAT achieves 0.93 average SR on UnrealCV (+2.2% vs. SOTA TrackVLA), 90.8% average CAR on real-world datasets (+12.1% vs. SOTA GC-VAT), and 81.6% TSR on a DJI Tello drone. Running at 35 FPS on an RTX 3090, it delivers robust, real-time performance for practical deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。