arXiv:2505.00820cs.RO2025-05被引 8

用大模型让多机器人协作更智能,人只在关键时介入

HMCF: A Human-in-the-loop Multi-Robot Collaboration Framework Based on Large Language Models

  • 大模型为每台机器人生成任务指令并验证,减少错误
  • 仿真中任务成功率提升4.76%,实测可零样本适应新场景
  • 适合灾难救援等高风险、复杂环境下的多机协同

人工智能的快速发展使机器人能自主完成复杂任务。然而,多机器人系统在泛化能力、异构性与安全性方面仍面临挑战,尤其在灾害响应等大规模部署中。传统方法泛化能力差,需大量工程适配新任务和场景,且难以管理多样机器人。为此,我们提出基于大语言模型(LLMs)的人机协同多机器人框架(HMCF)。LLM增强系统适应性,通过推理不同任务与机器人能力实现动态协调,人类仅在必要时干预,保障安全可靠。框架融合人类监督、LLM代理与异构机器人,优化任务分配与执行。每台机器人配备具备能力理解、任务转译与指令生成能力的LLM代理,并通过任务验证与人类监督降低幻觉。仿真结果表明,该框架优于现有最先进任务规划方法,任务成功率提升4.76%。真实世界测试验证其强零样本泛化能力,可在极少人工干预下处理多样化任务与环境。

原文摘要 · Abstract (English)

Rapid advancements in artificial intelligence (AI) have enabled robots to performcomplex tasks autonomously with increasing precision. However, multi-robot systems (MRSs) face challenges in generalization, heterogeneity, and safety, especially when scaling to large-scale deployments like disaster response. Traditional approaches often lack generalization, requiring extensive engineering for new tasks and scenarios, and struggle with managing diverse robots. To overcome these limitations, we propose a Human-in-the-loop Multi-Robot Collaboration Framework (HMCF) powered by large language models (LLMs). LLMs enhance adaptability by reasoning over diverse tasks and robot capabilities, while human oversight ensures safety and reliability, intervening only when necessary. Our framework seamlessly integrates human oversight, LLM agents, and heterogeneous robots to optimize task allocation and execution. Each robot is equipped with an LLM agent capable of understanding its capabilities, converting tasks into executable instructions, and reducing hallucinations through task verification and human supervision. Simulation results show that our framework outperforms state-of-the-art task planning methods, achieving higher task success rates with an improvement of 4.76%. Real-world tests demonstrate its robust zero-shot generalization feature and ability to handle diverse tasks and environments with minimal human intervention.

多机器人大模型人机协同任务规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。