用大模型提升无人机智能,实现更自主的空中作业与通信。
Large Language Model-Assisted UAV Operations and Communications: A Multifaceted Survey and Tutorial
- 将大模型融入无人机系统,实现环境理解与任务推理。
- 支持编队控制、路径规划、网络管理等多场景智能操作。
- 适合研究智能飞行、人机协同与自动化系统的开发者。
无人飞行器(UAV)因其机动性和灵活性被广泛应用于各类场景。近年来,大语言模型(LLMs)为超越传统优化与学习方法的无人机智能提供了变革性机遇。通过将LLMs集成到无人机系统中,可实现高级环境理解、编队协调、移动优化及高层任务推理,从而支持更自适应、上下文感知的空中作业。本综述系统探讨了LLMs与无人机技术的交叉领域,提出一个统一框架,整合现有架构、方法与应用。首先,构建了针对无人机的LLM适配技术分类体系,包括预训练、微调、检索增强生成(RAG)和提示工程,并涵盖链式思维(CoT)与上下文学习(ICL)等关键推理能力。随后,分析了大模型辅助的无人机通信与操作,涵盖导航、任务规划、编队控制、安全、自主性与网络管理。进一步讨论了多模态大模型(MLLMs)在人-蜂群交互、感知驱动导航与协作控制中的应用。最后,探讨伦理问题,包括偏见、透明度、责任归属及人在回路(HITL)策略,并展望未来研究方向。总体而言,该工作将大模型辅助无人机定位为智能、自适应空基系统的基石。
原文摘要 · Abstract (English)
Uncrewed Aerial Vehicles (UAVs) are widely deployed across diverse applications due to their mobility and agility. Recent advances in Large Language Models (LLMs) offer a transformative opportunity to enhance UAV intelligence beyond conventional optimization-based and learning-based approaches. By integrating LLMs into UAV systems, advanced environmental understanding, swarm coordination, mobility optimization, and high-level task reasoning can be achieved, thereby allowing more adaptive and context-aware aerial operations. This survey systematically explores the intersection of LLMs and UAV technologies and proposes a unified framework that consolidates existing architectures, methodologies, and applications for UAVs. We first present a structured taxonomy of LLM adaptation techniques for UAVs, including pretraining, fine-tuning, Retrieval-Augmented Generation (RAG), and prompt engineering, along with key reasoning capabilities such as Chain-of-Thought (CoT) and In-Context Learning (ICL). We then examine LLM-assisted UAV communications and operations, covering navigation, mission planning, swarm control, safety, autonomy, and network management. After that, the survey further discusses Multimodal LLMs (MLLMs) for human-swarm interaction, perception-driven navigation, and collaborative control. Finally, we address ethical considerations, including bias, transparency, accountability, and Human-in-the-Loop (HITL) strategies, and outline future research directions. Overall, this work positions LLM-assisted UAVs as a foundation for intelligent and adaptive aerial systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。