arXiv:2608.19866cs.CV2026-08中稿 · the 2026 IEEE/ASME…

微无人机在无GPS环境下靠视觉自动转向,避险保数据。

A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environments

论文配图:A 360-Degree Vision Dataset for Learning Yaw Control on GPS-Denied Micro-UAVs in Disaster-Response-Relevant Environments
图 1 · 摘自论文原文
  • 用360度摄像头采集实景,转为平面图训练神经网络预测方向。
  • 模型能从单帧图像连续输出转向指令,测试集表现可行。
  • 适合灾难救援中通信中断时的自主返航,需注意反光干扰。

本文提出一种基于数据驱动的微无人机视觉自主导航方法,适用于无GPS、通信受限的室内环境。目标场景为灾害与应急响应,如火灾及化学、生物、辐射、核(CBRN)事件,可快速获取现场态势,降低人员风险。通信中断后,无人机利用预训练的偏航控制器自主飞向开阔区域,保护机载传感器数据。使用配备360度相机的定制微无人机,采集了代表通信中断作业场景的工业、地下及训练环境数据。我们设计了一套预处理流程,将等距投影的360度视频转换为平面前视图,并动态生成图像-标签对用于AI训练。随后训练并比较多种卷积神经网络变体,从单目图像中预测连续偏航指令。在保留测试集上的评估验证了该学习型偏航预测方法的可行性。半自主实地测试进一步证明了方法的实际应用潜力,但也揭示了反射和强光是主要失效模式。

原文摘要 · Abstract (English)

This paper presents a novel data-driven approach to camera-based autonomy for micro-drones in GPS-denied, radio-challenging indoor environments. The target application is disaster and emergency response, where micro-UAVs can provide rapid situational awareness in hazardous settings such as firefighting and chemical, biological, radiological, and nuclear (CBRN) incidents while reducing risk for human responders. When the communication link is lost, the micro-drone uses a learned yaw controller to autonomously navigate toward open space, preserving onboard sensor data that would otherwise be lost with the vehicle. A custom micro-drone equipped with a 360-degree camera was used to record diverse industrial, underground, and training scenarios representative of communication-denied field operations. We introduce a preprocessing pipeline that converts equirectangular 360-degree footage into planar front views and dynamically generates image-label pairs for AI training. We then train and compare multiple convolutional neural network variants that predict a continuous yaw command from a single monocular view. Evaluation on a held-out test set confirms the feasibility of the learned yaw-prediction approach. A semi-autonomous real-world test further demonstrates the practicality of the method while revealing key failure modes, particularly reflections and glare.

微无人机视觉导航灾后救援360度视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。