用大模型自动选机器人规划控制策略,省去人工调参。
AuDeRe: Automated Strategy Decision and Realization in Robot Planning and Control via LLMs
- 大模型根据任务描述自动选择最优规划控制方案。
- 在复杂任务中表现优于直接生成轨迹或代码的基线方法。
- 适合希望提升机器人自主性的研发人员和工程师。
大语言模型(LLMs)在机器人领域展现出巨大潜力,但以往工作多直接预测路径点或在固定工具框架内使用LLM,灵活性不足。本文提出一种新框架,利用LLM根据任务描述、环境约束和系统动态自动选择合适的规划与控制策略,并通过调用现有完整规划控制API执行。该方法采用迭代式LLM推理并结合性能反馈优化算法选择。我们在多种复杂度的任务上进行了大量实验,涵盖从简单跟踪到涉及时空约束的复杂场景。结果表明,基于自然语言描述由LLM决定规划控制策略能显著提升机器人自主性,减少对人工调参和专家知识的依赖。同时,该框架具备跨任务泛化能力,明显优于依赖LLM直接生成轨迹、控制序列或代码的基线方法。
原文摘要 · Abstract (English)
Recent advancements in large language models (LLMs) have shown significant promise in various domains, especially robotics. However, most prior LLM-based work in robotic applications either directly predicts waypoints or applies LLMs within fixed tool integration frameworks, offering limited flexibility in exploring and configuring solutions best suited to different tasks. In this work, we propose a framework that leverages LLMs to select appropriate planning and control strategies based on task descriptions, environmental constraints, and system dynamics. These strategies are then executed by calling the available comprehensive planning and control APIs. Our approach employs iterative LLM-based reasoning with performance feedback to refine the algorithm selection. We validate our approach through extensive experiments across tasks of varying complexity, from simple tracking to complex planning scenarios involving spatiotemporal constraints. The results demonstrate that using LLMs to determine planning and control strategies from natural language descriptions significantly enhances robotic autonomy while reducing the need for extensive manual tuning and expert knowledge. Furthermore, our framework maintains generalizability across different tasks and notably outperforms baseline methods that rely on LLMs for direct trajectory, control sequence, or code generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。