让无人机群通过语言模型自适应分工,提升协同导航效率。
RALLY: Role-Adaptive LLM-Driven Yoked Navigation for Agentic UAV Swarms
- 用自然语言实现智能体间语义协作与动态角色切换
- 结合离线先验与在线学习,任务覆盖率提升23%以上
- 适合需要灵活分工的多无人机协同任务场景
无人飞行器(UAV)群智能控制已成为研究重点,需在避障前提下完成多目标持续覆盖。传统多智能体强化学习(MARL)存在语义沟通鸿沟和同质角色僵化问题,导致泛化能力差、任务扩展性弱。基于大语言模型(LLM)的控制框架虽具备强语义推理能力,但缺乏在线学习机制且过度依赖静态先验,影响探索效率与系统性能。为此,本文提出角色自适应的LLM驱动协同导航算法RALLY:首先构建基于结构化自然语言的语义决策框架,实现高效协作;其次引入动态角色异质机制,支持自适应角色切换与个性化决策;最后设计基于RMIX的角色价值混合网络,融合LLM离线先验与MARL在线策略,实现角色选择策略的半离线训练。在多智能体粒子环境(MPE)与软硬件在环(SITL)平台上的实验表明,RALLY在任务覆盖率、收敛速度与泛化能力上均优于传统方法,展现出在智能无人机群协同导航中的显著潜力。
原文摘要 · Abstract (English)
Intelligent control of Unmanned Aerial Vehicles (UAVs) swarms has emerged as a critical research focus, and it typically requires the swarm to navigate effectively while avoiding obstacles and achieving continuous coverage over multiple mission targets. Although traditional Multi-Agent Reinforcement Learning (MARL) approaches offer dynamic adaptability, they are hindered by the semantic gap in numerical communication and the rigidity of homogeneous role structures, resulting in poor generalization and limited task scalability. Recent advances in Large Language Model (LLM)-based control frameworks demonstrate strong semantic reasoning capabilities by leveraging extensive prior knowledge. However, due to the lack of online learning and over-reliance on static priors, these works often struggle with effective exploration, leading to reduced individual potential and overall system performance. To address these limitations, we propose a Role-Adaptive LLM-Driven Yoked navigation algorithm RALLY. Specifically, we first develop an LLM-driven semantic decision framework that uses structured natural language for efficient semantic communication and collaborative reasoning. Afterward, we introduce a dynamic role-heterogeneity mechanism for adaptive role switching and personalized decision-making. Furthermore, we propose a Role-value Mixing Network (RMIX)-based assignment strategy that integrates LLM offline priors with MARL online policies to enable semi-offline training of role selection strategies. Experiments in the Multi-Agent Particle Environment (MPE) environment and a Software-In-The-Loop (SITL) platform demonstrate that RALLY outperforms conventional approaches in terms of task coverage, convergence speed, and generalization, highlighting its strong potential for collaborative navigation in agentic multi-UAV systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。