arXiv:2412.07392cs.CVcs.RO2024-12被引 11

为无人船设计视觉追踪框架,提升复杂海况下的稳定跟踪能力。

Benchmarking Vision-Based Object Tracking for USVs in Complex Maritime Environments

  • 融合先进追踪算法与低层控制系统,实现动态海面精准追踪。
  • 实测表明,基于Transformer的SeqTrack在沙尘暴等恶劣条件下表现最优。
  • 线性二次调节器(LQR)控制效果最稳,适合高动态海况应用。

基于视觉的目标追踪对无人水面艇(USVs)执行巡检、监控和监视等任务至关重要。然而,在复杂海况下,由于相机动态运动、能见度低及目标尺度变化,实时追踪仍具挑战性。通常采用目标检测结合滤波技术进行追踪,但面对相机运动和漏检时鲁棒性不足。尽管近期提出了多种先进追踪方法,其在海事场景中的应用仍有限。为此,本研究提出一种面向USV的视觉引导追踪框架,将前沿深度学习追踪算法与底层控制系统集成,以实现动态海况下的精确追踪。我们基于模拟与真实海事数据集,对七种不同追踪器进行了基准测试,这些追踪器采用孪生网络和Transformer等先进技术。同时评估了多种控制算法与追踪系统协同工作的鲁棒性。该框架通过仿真与海上实测验证,结果表明:在恶劣条件(如沙尘暴)下,基于Transformer的SeqTrack表现最佳;在控制算法中,线性二次调节器(LQR)展现出最强鲁棒性与平滑控制能力,保障了无人船的稳定追踪。

原文摘要 · Abstract (English)

Vision-based target tracking is crucial for unmanned surface vehicles (USVs) to perform tasks such as inspection, monitoring, and surveillance. However, real-time tracking in complex maritime environments is challenging due to dynamic camera movement, low visibility, and scale variation. Typically, object detection methods combined with filtering techniques are commonly used for tracking, but they often lack robustness, particularly in the presence of camera motion and missed detections. Although advanced tracking methods have been proposed recently, their application in maritime scenarios is limited. To address this gap, this study proposes a vision-guided object-tracking framework for USVs, integrating state-of-the-art tracking algorithms with low-level control systems to enable precise tracking in dynamic maritime environments. We benchmarked the performance of seven distinct trackers, developed using advanced deep learning techniques such as Siamese Networks and Transformers, by evaluating them on both simulated and real-world maritime datasets. In addition, we evaluated the robustness of various control algorithms in conjunction with these tracking systems. The proposed framework was validated through simulations and real-world sea experiments, demonstrating its effectiveness in handling dynamic maritime conditions. The results show that SeqTrack, a Transformer-based tracker, performed best in adverse conditions, such as dust storms. Among the control algorithms evaluated, the linear quadratic regulator controller (LQR) demonstrated the most robust and smooth control, allowing for stable tracking of the USV.

视觉追踪无人船海事场景Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。