让无人机群通过自然语言指令自动执行任务,无需编写代码。
Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones

- 用大模型+标准化接口实现自然语言控制无人机群
- 六种大模型中多数任务执行失败,需额外工具保障可靠
- 适合想用自然语言指挥无人机的科研与工程人员
大型语言模型(LLMs)正被探索作为网络物理系统中的高层推理引擎,但其在实时无人机群管理中的应用仍面临异构接口、缺乏实体锚定及长期闭环执行等挑战。本文提出一种任务无关的、基于代理的增强型LLM框架,用户以自然语言表达任务目标,系统通过具身化、实时交互自主执行。该架构结合基于LLM的代理核心、模型上下文协议(MCP)网关,以及基于W3C Web of Things(WoT)标准的“无人机网络”抽象。通过将无人机、传感器和服务暴露为标准化的WoT Thing,框架实现了结构化工具交互、持续状态观测和安全执行,无需依赖代码生成。我们在基于ArduPilot的仿真环境中,对四个群组任务和六种先进大模型进行了评估。结果表明,尽管当前通用大模型具备强大推理能力,但在缺乏显式锚定和执行支持的情况下,仍难以可靠完成简单群组任务。专用规划工具与运行时约束机制显著提升鲁棒性,而令牌消耗量并不能反映执行质量或可靠性。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly explored as high-level reasoning engines for cyber-physical systems, yet their application to real-time UAV swarm management remains challenging due to heterogeneous interfaces, limited grounding, and the need for long-running closed-loop execution. This paper presents a mission-agnostic, agent-enhanced LLM framework for UAV swarm control, where users express mission objectives in natural language and the system autonomously executes them through grounded, real-time interactions. The proposed architecture combines an LLM-based Agent Core with a Model Context Protocol (MCP) gateway and a Web-of-Drones abstraction based on W3C Web of Things (WoT) standards. By exposing drones, sensors, and services as standardized WoT Things, the framework enables structured tool-based interaction, continuous state observation, and safe actuation without relying on code generation. We evaluate the framework using ArduPilot-based simulation across four swarm missions and six state-of-the-art LLMs. Results show that, despite strong reasoning abilities, current general-purpose LLMs still struggle to achieve reliable execution - even for simple swarm tasks - when operating without explicit grounding and execution support. Task-specific planning tools and runtime guardrails substantially improve robustness, while token consumption alone is not indicative of execution quality or reliability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。