arXiv:2508.07885cs.ROcs.AI2025-08被引 3

无人机在无GPS室内环境自主导航,靠云端大模型和多模态感知。

Autonomous Navigation of Cloud-Controlled Quadcopters in Confined Spaces Using Multi-Modal Perception and LLM-Driven High Semantic Reasoning

论文配图:Autonomous Navigation of Cloud-Controlled Quadcopters in Confined Spaces Using Multi-Modal Perception and LLM-Driven High Semantic Reasoning
图 1 · 摘自论文原文
  • 用云端大模型结合视觉与传感器数据做智能决策
  • 检测准确率mAP50达0.6,深度估计误差仅7.2厘米
  • 适合对安全性和智能要求高的室内无人机应用

本文提出一种面向无GPS室内环境的无人机自主导航先进感知系统。该框架利用云计算卸载计算密集型任务,采用定制印刷电路板(PCB)高效采集传感器数据,实现复杂空间下的稳定导航。系统集成YOLOv11用于目标检测,Depth Anything V2进行单目深度估计,配备飞行时间(ToF)传感器和惯性测量单元(IMU)的PCB,以及基于云端的大语言模型(LLM)实现上下文感知决策。通过校准传感器偏移构建虚拟安全边界,结合多线程架构实现低延迟处理。3D边界框估计结合卡尔曼滤波提升空间感知能力。在室内测试中表现优异:目标检测平均精度(mAP50)为0.6,深度估计均方误差(MAE)为7.2厘米,在约11分钟内42次试验中仅发生16次安全边界突破,端到端系统延迟低于1秒。该云支持的高智能框架可作为现有无人机自主系统的辅助感知与导航方案。

原文摘要 · Abstract (English)

This paper introduces an advanced AI-driven perception system for autonomous quadcopter navigation in GPS-denied indoor environments. The proposed framework leverages cloud computing to offload computationally intensive tasks and incorporates a custom-designed printed circuit board (PCB) for efficient sensor data acquisition, enabling robust navigation in confined spaces. The system integrates YOLOv11 for object detection, Depth Anything V2 for monocular depth estimation, a PCB equipped with Time-of-Flight (ToF) sensors and an Inertial Measurement Unit (IMU), and a cloud-based Large Language Model (LLM) for context-aware decision-making. A virtual safety envelope, enforced by calibrated sensor offsets, ensures collision avoidance, while a multithreaded architecture achieves low-latency processing. Enhanced spatial awareness is facilitated by 3D bounding box estimation with Kalman filtering. Experimental results in an indoor testbed demonstrate strong performance, with object detection achieving a mean Average Precision (mAP50) of 0.6, depth estimation Mean Absolute Error (MAE) of 7.2 cm, only 16 safety envelope breaches across 42 trials over approximately 11 minutes, and end-to-end system latency below 1 second. This cloud-supported, high-intelligence framework serves as an auxiliary perception and navigation system, complementing state-of-the-art drone autonomy for GPS-denied confined spaces.

无人机导航多模态感知大模型应用室内定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。