arXiv:2510.01869cs.ROcs.AI2025-10被引 4

用大模型实现无人机群的自然语言控制,让单人轻松管理多架无人机。

TACOS: Task Agnostic COordinator of a multi-drone System

  • 通过大模型构建语言接口,将指令转为任务计划。
  • 在真实系统中实现多机协同,支持从手动到全自动的灵活模式。
  • 适合无人机集群指挥、科研实验及低门槛智能控制场景。

当一名飞行员需管理多架无人机系统时,任务可能需要不同层次的自主性,从个别无人机的直接操控,到群体层面的协调,再到完成高层次任务所需的完全自主蜂群行为。实现这种灵活交互需要一个支持多种共享自主模式的框架。随着语言模型在推理和规划能力上的提升,它们为这类系统提供了天然基础,通过直观的语言接口实现高层任务委托,降低操作员负担。本文提出 TACOS(Task-Agnostic COordinator of a multi-drone System),一个统一框架,利用大型语言模型(LLMs)实现对多无人机系统的高层自然语言控制。TACOS 将三大核心能力集成于单一架构:支持一对多的自然语言接口以实现直观用户交互;智能协调器将用户意图转化为结构化任务计划;以及可自主执行计划并与真实世界交互的代理。TACOS 使大模型能够调用可执行的 API 库,实现语义推理与实时多机器人协调的桥梁。我们在真实多无人机系统上验证了该系统,并通过消融实验评估各模块的贡献。

原文摘要 · Abstract (English)

When a single pilot is responsible for managing a multi-drone system, the task may demand varying levels of autonomy, from direct control of individual UAVs, to group-level coordination, to fully autonomous swarm behaviors for accomplishing high-level tasks. Enabling such flexible interaction requires a framework that supports multiple modes of shared autonomy. As language models continue to improve in reasoning and planning, they provide a natural foundation for such systems, reducing pilot workload by enabling high-level task delegation through intuitive, language-based interfaces. In this paper we present TACOS (Task-Agnostic COordinator of a multi-drone System), a unified framework that enables high-level natural language control of multi-UAV systems through Large Language Models (LLMs). TACOS integrates three key capabilities into a single architecture: a one-to-many natural language interface for intuitive user interaction, an intelligent coordinator for translating user intent into structured task plans, and an autonomous agent that executes plans interacting with the real world. TACOS allows a LLM to interact with a library of executable APIs, bridging semantic reasoning with real-time multi-robot coordination. We demonstrate the system on a real-world multi-drone system, and conduct an ablation study to assess the contribution of each module.

无人机群大模型自然语言控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。