用语言指令统一协调多机器人,让它们行动一致且任务对齐。
ICCO: Learning an Instruction-conditioned Coordinator for Language-guided Task-aligned Multi-robot Control
- 引入协调者代理,融合语言指令与环境状态生成一致指令
- 联合训练提升任务效率和指令遵循度,实测行为一致性显著改善
- 适合需要多机器人协同执行复杂语言指令的场景
大型语言模型(LLMs)的发展推动了基于自然语言指令的多机器人系统。然而,在分布式多智能体环境中实现有效协调仍面临两大挑战:(1)语言指令与任务需求不匹配;(2)机器人独立解读模糊指令导致行为不一致。为此,我们提出指令条件协调框架ICCO,一种多智能体强化学习方法。ICCO包含一个协调者代理和多个本地代理,协调者结合语言指令与环境状态生成任务对齐且行为一致的指令(TACI),确保任务一致性。协调者与本地代理联合训练,优化兼顾任务效率与指令遵循的奖励函数,并加入一致性增强项以最大化指令与机器人行为间的互信息,进一步提升协调性。仿真与真实世界实验验证了ICCO在语言引导的多机器人任务对齐控制中的有效性。演示视频见https://yanoyoshiki.github.io/ICCO/。
原文摘要 · Abstract (English)
Recent advances in Large Language Models (LLMs) have permitted the development of language-guided multi-robot systems, which allow robots to execute tasks based on natural language instructions. However, achieving effective coordination in distributed multi-agent environments remains challenging due to (1) misalignment between instructions and task requirements and (2) inconsistency in robot behaviors when they independently interpret ambiguous instructions. To address these challenges, we propose Instruction-Conditioned Coordinator (ICCO), a Multi-Agent Reinforcement Learning (MARL) framework designed to enhance coordination in language-guided multi-robot systems. ICCO consists of a Coordinator agent and multiple Local Agents, where the Coordinator generates Task-Aligned and Consistent Instructions (TACI) by integrating language instructions with environmental states, ensuring task alignment and behavioral consistency. The Coordinator and Local Agents are jointly trained to optimize a reward function that balances task efficiency and instruction following. A Consistency Enhancement Term is added to the learning objective to maximize mutual information between instructions and robot behaviors, further improving coordination. Simulation and real-world experiments validate the effectiveness of ICCO in achieving language-guided task-aligned multi-robot control. The demonstration can be found at https://yanoyoshiki.github.io/ICCO/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。