用大模型让多机器人自动拆解有依赖关系的任务并协作执行
DART-LLM: Dependency-Aware Multi-Robot Task Decomposition and Execution using Large Language Models
- 用有向无环图建模任务依赖,从自然语言指令中分解出协调子任务
- 在三种复杂度任务上均超越基线,最高效模型成功率达92.3%
- 适合资源受限场景,小模型性能因依赖建模提升显著
大型语言模型(LLMs)在机器人领域展现出强大的推理能力,但在多机器人系统中的应用仍受限,尤其难以处理任务依赖。本文提出DART-LLM框架,利用有向无环图(DAG)建模任务依赖,将自然语言指令分解为可协同执行的子任务,实现端到端多机器人任务执行。该框架包含四个核心模块:基于问答的LLM模块用于依赖感知的任务分解,分解函数模块负责机器人分配,执行模块实现动作控制,以及基于视觉-语言模型(VLM)的物体检测模块用于环境感知。在三个不同复杂度的任务上进行实验,结果表明DART-LLM达到当前最优性能,显著优于基线。测试中,DeepSeek-r1-671B模型取得最高成功率,而Llama-3.1-8B在响应时间稳定性方面表现更优。消融实验进一步验证,显式依赖建模显著提升小型模型性能,有利于在资源受限平台部署。更多视频与代码见项目主页 https://wyd0817.github.io/project-dart-llm/
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated promising reasoning capabilities in robotics; however, their application in multi-robot systems remains limited, particularly in handling task dependencies. This paper introduces DART-LLM, a novel framework that employs Directed Acyclic Graphs (DAGs) to model task dependencies, enabling the decomposition of natural language instructions into well-coordinated subtasks for multi-robot execution. DART-LLM comprises four key components: a Question-Answering (QA) LLM module for dependency-aware task decomposition, a Breakdown Function module for robot assignment, an Actuation module for execution, and a Vision-Language Model (VLM)-based object detector for environmental perception, achieving end-to-end task execution. Experimental results across three task complexity levels demonstrate that DART-LLM achieves state-of-the-art performance, significantly outperforming the baseline across all evaluation metrics. Among the tested models, DeepSeek-r1-671B achieves the highest success rate, whereas Llama-3.1-8B exhibits superior response time reliability. Ablation studies further confirm that explicit dependency modeling notably enhances the performance of smaller models, facilitating efficient deployment on resource-constrained platforms. Please refer to the project website https://wyd0817.github.io/project-dart-llm/ for videos and code.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。