arXiv:2501.02341cs.ROcs.AI2025-01被引 121

用大模型让无人机自主决策,实现智能低空飞行

UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility

  • 将大模型引入无人机系统,提升其自主感知与决策能力
  • 提出面向智能无人机的多模态数据资源与任务分类框架
  • 适合对智能交通、自主机器人感兴趣的开发者和研究者

低空移动性,以无人飞行器(UAVs)为代表,在交通、物流、农业等领域带来变革性进展。凭借灵活视角和快速机动能力,无人机拓展了传统系统的感知与行动边界,受到学界与产业界广泛关注。然而当前无人机操作仍高度依赖人工控制,仅在简单场景具备有限自主性,缺乏应对复杂环境与任务所需的智能与适应能力。大语言模型(LLMs)展现出卓越的问题求解与泛化能力,为提升无人机智能水平提供了新路径。本文系统探讨了LLMs与UAVs的融合,首先概述了无人机系统的基本构成与功能,继而梳理了大模型技术的最新进展。随后,系统分析了可用于无人机训练与评估的多模态数据资源,并分类讨论了二者融合的关键任务与应用场景。最后,提出了迈向智能无人机的参考路线图,旨在通过自主感知、记忆、推理与工具使用,使无人机具备代理式智能。相关资源见 https://github.com/Hub-Tian/UAVs_Meet_LLMs。

原文摘要 · Abstract (English)

Low-altitude mobility, exemplified by unmanned aerial vehicles (UAVs), has introduced transformative advancements across various domains, like transportation, logistics, and agriculture. Leveraging flexible perspectives and rapid maneuverability, UAVs extend traditional systems' perception and action capabilities, garnering widespread attention from academia and industry. However, current UAV operations primarily depend on human control, with only limited autonomy in simple scenarios, and lack the intelligence and adaptability needed for more complex environments and tasks. The emergence of large language models (LLMs) demonstrates remarkable problem-solving and generalization capabilities, offering a promising pathway for advancing UAV intelligence. This paper explores the integration of LLMs and UAVs, beginning with an overview of UAV systems' fundamental components and functionalities, followed by an overview of the state-of-the-art in LLM technology. Subsequently, it systematically highlights the multimodal data resources available for UAVs, which provide critical support for training and evaluation. Furthermore, it categorizes and analyzes key tasks and application scenarios where UAVs and LLMs converge. Finally, a reference roadmap towards agentic UAVs is proposed, aiming to enable UAVs to achieve agentic intelligence through autonomous perception, memory, reasoning, and tool utilization. Related resources are available at https://github.com/Hub-Tian/UAVs_Meet_LLMs.

无人机大模型智能系统自主决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。