让无人机稳定跟拍目标,实现精准视角控制
StableTracker: Learning to Stably Track Target via Differentiable Simulation
- 通过可微分仿真训练控制策略,端到端学习跟踪
- 在仿真和真实飞行中均保持目标居中且距离固定
- 适合需要稳定航拍的无人机应用
现有第一人称视觉目标跟踪方法多依赖人工设计模块化流程,导致机载计算开销大且误差累积。虽基于学习的方法缓解了延迟问题,但多数仅生成位置与偏航的高层轨迹,与独立控制器耦合松散,难以实现精确姿态控制。即使目标定位准确,机体固定相机仍可能无法持续对准目标,尤其在高机动目标追踪时易丢失。为此,我们提出StableTracker,一种基于学习的控制策略,使四旋翼无人机能从任意视角鲁棒跟踪移动目标。该策略通过反向传播时间(backpropagation-through-time)在可微分仿真中训练,使无人机保持固定相对距离,并始终将目标置于视觉视野的水平与垂直中心,从而作为自主空中摄像机运行。与先进传统算法及学习基线对比,仿真结果表明其在不同安全距离、轨迹与目标速度下均具备更优的精度、稳定性与泛化能力。此外,搭载于机载计算机的真实四旋翼实验验证了该方法的实用性。
原文摘要 · Abstract (English)
Existing FPV object tracking methods heavily rely on handcrafted modular pipelines, which incur high onboard computation and cumulative errors. While learning-based approaches have mitigated computational delays, most still generate only high-level trajectories (position and yaw). This loose coupling with a separate controller sacrifices precise attitude control; consequently, even if target is localized precisely, accurate target estimation does not ensure that the body-fixed camera is consistently oriented toward the target, it still probably degrades and loses target when tracking high-maneuvering target. To address these challenges, we present StableTracker, a learning-based control policy that enables quadrotors to robustly follow a moving target from arbitrary viewpoints. The policy is trained using backpropagation-through-time via differentiable simulation, allowing the quadrotor to keep a fixed relative distance while maintaining the target at the center of the visual field in both horizontal and vertical directions, thereby functioning as an autonomous aerial camera. We compare StableTracker against state-of-the-art traditional algorithms and learning baselines. Simulation results demonstrate superior accuracy, stability, and generalization across varying safe distances, trajectories, and target velocities. Furthermore, real-world experiments on a quadrotor with an onboard computer validate the practicality of the proposed approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。