用轻量LLM+反馈机制让机器人更高效地完成复杂任务
DaDu-E: Rethinking the Role of Large Language Model in Robotic Computing Pipeline
- 轻量LLM配合封装技能与反馈系统,实现闭环控制
- 任务成功率媲美大模型系统,计算量降低6.6倍
- 适合需要低延迟、高鲁棒性的实际机器人应用
在开放环境中执行复杂任务对机器人仍具挑战性,即使使用大语言模型(LLMs)作为核心规划器。许多基于LLM的规划器因参数量过大而效率低下,且因处于开环系统中易出错。我们认为问题在于仅将LLM用作规划器不够。本文提出DaDu-E,一种面向具身智能机器人的鲁棒闭环规划框架。该框架包含轻量级LLM、一组封装好的机器人技能指令、稳健的反馈系统及记忆增强机制。这些组件共同使DaDu-E能够:(i) 主动感知并适应动态环境,(ii) 在保持高性能的同时优化计算成本,(iii) 利用记忆和反馈机制从执行失败中恢复。在真实世界和模拟任务上的大量实验表明,DaDu-E达到与采用大模型作为规划器的COME-Robot相当的任务成功率,同时计算需求减少6.6倍。
原文摘要 · Abstract (English)
Performing complex tasks in open environments remains challenging for robots, even when using large language models (LLMs) as the core planner. Many LLM-based planners are inefficient due to their large number of parameters and prone to inaccuracies because they operate in open-loop systems. We think the reason is that only applying LLMs as planners is insufficient. In this work, we propose DaDu-E, a robust closed-loop planning framework for embodied AI robots. Specifically, DaDu-E is equipped with a relatively lightweight LLM, a set of encapsulated robot skill instructions, a robust feedback system, and memory augmentation. Together, these components enable DaDu-E to (i) actively perceive and adapt to dynamic environments, (ii) optimize computational costs while maintaining high performance, and (iii) recover from execution failures using its memory and feedback mechanisms. Extensive experiments on real-world and simulated tasks show that DaDu-E achieves task success rates comparable to embodied AI robots with larger models as planners like COME-Robot, while reducing computational requirements by $6.6 \times$. Users are encouraged to explore our system at: \url{https://rlc-lab.github.io/dadu-e/}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。