让无人机在3D动态环境中主动追踪目标,突破传统静态视频局限。
DeTrack: A Benchmark and Altitude-Aware Dual World Model for Drone-embodied Tracking

- 构建无人机具身追踪新任务与大规模基准数据集
- 提出双高度感知世界模型,提升追踪精度与安全性
- 适合无人机自主导航、智能监控等场景研究者
航拍目标追踪在公共安全、应急救援、野生动物监测等领域有广泛应用。然而,现有航拍追踪基准多基于固定摄像头或预设飞行路径的被动2D视频序列,将无人机视为被动摄像机而非能主动感知、交互并控制运动的具身智能体。本文定义了一种新的无人机具身追踪任务——DeTrack,要求无人机在交互式3D环境中,利用在线自视角观测和主动飞行控制,实现闭环追踪。我们构建了一个大规模基准,包含11,368条目标轨迹,覆盖多样场景、渲染条件、语义区域及移动干扰物,并设计了目标可见性、追踪精度与轨迹成功率评估指标。进一步提出AaDWorlds——一种高度感知的双世界模型框架,包含高度感知感知模块和高/低空双模式未来状态预测模型。通过伪高度感知观测与想象未来状态相结合,缓解了目标可见性与飞行安全之间的固有矛盾。在DeTrack基准上的实验表明,AaDWorlds在所有评估指标上均显著提升闭环追踪性能。
原文摘要 · Abstract (English)
Aerial object tracking has broad applications in public safety, emergency rescue, wildlife monitoring, and related fields. However, existing aerial tracking benchmarks are mainly based on passive 2D video sequences captured from fixed camera locations or predefined flight paths, where drones are treated as passive cameras rather than embodied agents that actively perceive, interact, and control their motion in dynamic 3D scenes. In this paper, we define a new drone-embodied tracking task, termed DeTrack, which requires a drone to track a target in interactive 3D environments using online egocentric observations and active flight control in a closed loop. We build a large-scale benchmark containing 11,368 target trajectories across diverse scenes, rendering conditions, semantic regions, and moving distractors, together with evaluation metrics for target visibility, tracking accuracy, and trajectory success. We further propose AaDWorlds, an altitude-aware dual world model framework for drone-embodied tracking. AaDWorlds consists of an altitude-aware perception module and dual world models that imagine future states under both high- and low-altitude regimes. By combining pseudo altitude-aware observations and imagined future states, AaDWorlds alleviates the intrinsic altitude-mediated contradiction between target visibility and flight safety. Experiments on the DeTrack benchmark demonstrate that AaDWorlds improves closed-loop tracking performance across all evaluation metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。