用静态文本模拟LLM生成机器人操作代码,无需物理实验或动态仿真。
LLM-Driven Corrective Robot Operation Code Generation with Static Text-Based Simulation
- 让LLM扮演静态模拟器,解析动作、推理状态变化、生成语义观测。
- 在无人机和小型地面车任务中,代码生成准确率接近顶尖水平。
- 适合想降低部署成本、无需动态环境的机器人研发人员使用。
大语言模型(LLMs)在生成机器人操作代码方面展现出巨大潜力。为提升代码可靠性,现有研究多采用执行反馈进行纠错,但依赖物理实验或定制仿真环境,配置复杂且耗时。本文探索直接利用LLM实现静态文本化机器人代码模拟,构建新的可靠性框架。该框架将LLM配置为具备动作解析、状态转移推理、执行结果分析与轨迹动态捕捉能力的静态模拟器。在多种机器人任务(包括UAV和小地面车辆)上验证表明,该静态文本模拟具有高精度,所提框架在不依赖物理实验或动态仿真器的前提下,达到与当前最优方法相当的代码生成性能。
原文摘要 · Abstract (English)
Recent advances in Large language models (LLMs) have demonstrated their promising capabilities of generating robot operation code to enable LLM-driven robots. To enhance the reliability of operation code generated by LLMs, corrective designs with feedback from the observation of executing code have been increasingly adopted in existing research. However, the code execution in these designs relies on either a physical experiment or a customized simulation environment, which limits their deployment due to the high configuration effort of the environment and the potential long execution time. In this paper, we explore the possibility of directly leveraging LLM to enable static simulation of robot operation code, and then leverage it to design a new reliable LLM-driven corrective robot operation code generation framework. Our framework configures the LLM as a static simulator with enhanced capabilities that reliably simulate robot code execution by interpreting actions, reasoning over state transitions, analyzing execution outcomes, and generating semantic observations that accurately capture trajectory dynamics. To validate the performance of our framework, we performed experiments on various operation tasks for different robots, including UAVs and small ground vehicles. The experiment results not only demonstrated the high accuracy of our static text-based simulation but also the reliable code generation of our LLM-driven corrective framework, which achieves a comparable performance with state-of-the-art research while does not rely on dynamic code execution using physical experiments or simulators.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。