用大模型让不同机器人协作完成复杂长任务,成功率远超以往方法。
COHERENT: Collaboration of Heterogeneous Multi-Robot System with Large Language Models
- 设计了提议-执行-反馈-调整机制,分步分配任务并动态修正计划。
- 在100个复杂长任务上,成功率与执行效率均显著优于现有方法。
- 适用于无人机、机器狗、机械臂等异构机器人协作,适合实际场景应用。
借助大语言模型强大的推理能力,基于LLM的机器人任务规划方法取得了良好进展。然而,现有方法主要聚焦于单一或同质机器人在简单任务上的应用。实际上,复杂长周期任务通常需要具备更复杂动作空间的异构机器人协同完成,这带来了更大挑战。为此,我们提出COHERENT,一种面向异构多机器人系统(包括四旋翼无人机、机器狗和机械臂)的新型LLM-based任务规划框架。具体地,设计了提议-执行-反馈-调整(PEFA)机制,由中心化任务分配器将复杂任务分解为子任务并分配给机器人执行者;每个执行者选择可行动作实现子任务,并向分配器报告自我反思反馈以进行计划调整,此循环持续直至任务完成。此外,我们构建了一个包含100个复杂长周期任务的挑战性异构多机器人任务规划基准。实验结果表明,该方法在成功率和执行效率方面大幅超越此前方法。相关视频、代码及基准已公开于https://github.com/MrKeee/COHERENT。
原文摘要 · Abstract (English)
Leveraging the powerful reasoning capabilities of large language models (LLMs), recent LLM-based robot task planning methods yield promising results. However, they mainly focus on single or multiple homogeneous robots on simple tasks. Practically, complex long-horizon tasks always require collaboration among multiple heterogeneous robots especially with more complex action spaces, which makes these tasks more challenging. To this end, we propose COHERENT, a novel LLM-based task planning framework for collaboration of heterogeneous multi-robot systems including quadrotors, robotic dogs, and robotic arms. Specifically, a Proposal-Execution-Feedback-Adjustment (PEFA) mechanism is designed to decompose and assign actions for individual robots, where a centralized task assigner makes a task planning proposal to decompose the complex task into subtasks, and then assigns subtasks to robot executors. Each robot executor selects a feasible action to implement the assigned subtask and reports self-reflection feedback to the task assigner for plan adjustment. The PEFA loops until the task is completed. Moreover, we create a challenging heterogeneous multi-robot task planning benchmark encompassing 100 complex long-horizon tasks. The experimental results show that our work surpasses the previous methods by a large margin in terms of success rate and execution efficiency. The experimental videos, code, and benchmark are released at https://github.com/MrKeee/COHERENT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。