arXiv:2412.00744cs.ROcs.AI2024-12NeurIPS被引 5

提出首个开放世界无人机视觉追踪基准与新强化学习方法,显著提升复杂环境追踪成功率。

Open-World Drone Active Tracking with Goal-Centered Rewards

  • 设计目标中心奖励机制,引导无人机从多视角自主优化追踪策略。
  • 在模拟环境中实现约72%的追踪成功率,优于现有方法。
  • 适合研究无人机自主追踪、强化学习应用的开发者和研究人员。

无人机视觉主动追踪旨在通过控制运动系统基于视觉观测自主跟踪目标物体,为动态环境中的有效追踪提供更实用的解决方案。然而,由于缺乏统一基准以及开放世界环境中频繁干扰带来的复杂性,基于强化学习的精准无人机视觉主动追踪仍具挑战。为此,我们提出首个系统性解决方案:首先,构建DAT——首个开放世界无人机空中对地面主动追踪基准,涵盖24个城市尺度场景,包含类人行为目标与高保真动力学仿真,并提供数字孪生工具以实现无限场景生成。其次,提出新型强化学习方法GC-VAT,设计目标中心奖励,跨视角提供精确反馈,使智能体通过无限制视角拓展感知与运动范围;受课程学习启发,引入基于课程的训练策略,逐步提升复杂环境下的追踪性能。仿真与真实图像实验表明,GC-VAT表现优异,在模拟环境中追踪成功率约达72%。相关基准与代码已开源:https://github.com/SHWplus/DAT_Benchmark。

原文摘要 · Abstract (English)

Drone Visual Active Tracking aims to autonomously follow a target object by controlling the motion system based on visual observations, providing a more practical solution for effective tracking in dynamic environments. However, accurate Drone Visual Active Tracking using reinforcement learning remains challenging due to the absence of a unified benchmark and the complexity of open-world environments with frequent interference. To address these issues, we pioneer a systematic solution. First, we propose DAT, the first open-world drone active air-to-ground tracking benchmark. It encompasses 24 city-scale scenes, featuring targets with human-like behaviors and high-fidelity dynamics simulation. DAT also provides a digital twin tool for unlimited scene generation. Additionally, we propose a novel reinforcement learning method called GC-VAT, which aims to improve the performance of drone tracking targets in complex scenarios. Specifically, we design a Goal-Centered Reward to provide precise feedback across viewpoints to the agent, enabling it to expand perception and movement range through unrestricted perspectives. Inspired by curriculum learning, we introduce a Curriculum-Based Training strategy that progressively enhances the tracking performance in complex environments. Besides, experiments on simulator and real-world images demonstrate the superior performance of GC-VAT, achieving a Tracking Success Rate of approximately 72% on the simulator. The benchmark and code are available at https://github.com/SHWplus/DAT_Benchmark.

无人机追踪强化学习数字孪生目标中心奖励

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。