用单目相机实现无人机对地面车的实时朝向预测,无需GPS
Visual Heading Prediction for Autonomous Aerial Vehicles
- 基于YOLOv5检测地面车,用轻量神经网络预测无人机朝向
- 误差仅0.15度,95%检测准确率,全靠单摄像头输入
- 适合无GPS环境下的多智能体协同,如搜救与巡检
无人机(UAV)与无人地面车(UGV)的融合正日益成为智能自主系统的核心,广泛应用于搜救、环境监测和物流等领域。然而,在缺乏外部定位基础设施(如GPS或GNSS)的情况下,实时协同面临巨大挑战。本文提出一种基于视觉的数据驱动框架,实现无人机与地面车的实时集成,重点解决地面车检测与无人机朝向角预测问题。系统采用微调后的YOLOv5模型检测UGV并提取边界框特征,再由轻量级人工神经网络(ANN)估计所需航向角。训练使用VICON运动捕捉系统生成超过13,000张标注图像的实验数据集。所训练的ANN在测试中实现平均绝对误差0.1506°,均方根误差0.1957°,仅依赖单目相机输入即可完成高精度航向预测。实验验证了95%的地面车检测准确率。本工作提供了一种不依赖基础设施的视觉解决方案,展现了在无GPS/GNSS环境下可靠多智能体协同的巨大潜力。演示视频展示系统在动态条件下的实时性能,包括目标检测、航向预测与无人机对齐,详见:https://github.com/Kooroshraf/UAV-UGV-Integration
原文摘要 · Abstract (English)
The integration of Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) is increasingly central to the development of intelligent autonomous systems for applications such as search and rescue, environmental monitoring, and logistics. However, precise coordination between these platforms in real-time scenarios presents major challenges, particularly when external localization infrastructure such as GPS or GNSS is unavailable or degraded [1]. This paper proposes a vision-based, data-driven framework for real-time UAV-UGV integration, with a focus on robust UGV detection and heading angle prediction for navigation and coordination. The system employs a fine-tuned YOLOv5 model to detect UGVs and extract bounding box features, which are then used by a lightweight artificial neural network (ANN) to estimate the UAV's required heading angle. A VICON motion capture system was used to generate ground-truth data during training, resulting in a dataset of over 13,000 annotated images collected in a controlled lab environment. The trained ANN achieves a mean absolute error of 0.1506° and a root mean squared error of 0.1957°, offering accurate heading angle predictions using only monocular camera inputs. Experimental evaluations achieve 95% accuracy in UGV detection. This work contributes a vision-based, infrastructure- independent solution that demonstrates strong potential for deployment in GPS/GNSS-denied environments, supporting reliable multi-agent coordination under realistic dynamic conditions. A demonstration video showcasing the system's real-time performance, including UGV detection, heading angle prediction, and UAV alignment under dynamic conditions, is available at: https://github.com/Kooroshraf/UAV-UGV-Integration
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。