arXiv:2508.19074cs.ROcs.AI2025-08被引 2

用语言模型生成机器人指令时,确保代码正确并自动纠错。

An LLM-powered Natural-to-Robotic Language Translation Framework with Correctness Guarantees

  • 用抽象的机器人技能语言桥接自然语言与控制程序
  • 通过编译器验证+反馈微调,让生成代码错误率大幅降低
  • 特别适合轻量级大模型在真实机器人上的应用

大型语言模型(LLM)正被用于将自然语言任务直接转化为机器人控制程序,以实现具身智能。然而,由于模型不一致性和任务复杂性,现有方法常产生大量编程错误,尤其在轻量级模型上表现更差。本文提出一种自然-机器人语言翻译框架NRTrans,具备两项核心能力:(i) 对生成的控制程序进行正确性验证;(ii) 通过反馈式微调提升LLM生成性能。为此,设计了机器人技能语言(RSL),抽象化控制程序细节,连接自然语言任务与底层机器人技能。构建RSL编译器与调试器,对LLM生成的RSL程序进行验证,并提供错误反馈以迭代优化输出,直至通过编译。该机制在部署前保证代码正确性,显著提升轻量级模型驱动机器人应用的有效性。实验表明,NRTrans在多种LLM和任务下均优于现有方法,尤其在轻量级模型上仍保持高成功率。

原文摘要 · Abstract (English)

The Large Language Models (LLM) are increasingly being deployed in robotics to generate robot control programs for specific user tasks, enabling embodied intelligence. Existing methods primarily focus on LLM training and prompt design that utilize LLMs to generate executable programs directly from user tasks in natural language. However, due to the inconsistency of the LLMs and the high complexity of the tasks, such best-effort approaches often lead to tremendous programming errors in the generated code, which significantly undermines the effectiveness especially when the light-weight LLMs are applied. This paper introduces a natural-robotic language translation framework that (i) provides correctness verification for generated control programs and (ii) enhances the performance of LLMs in program generation via feedback-based fine-tuning for the programs. To achieve this, a Robot Skill Language (RSL) is proposed to abstract away from the intricate details of the control programs, bridging the natural language tasks with the underlying robot skills. Then, the RSL compiler and debugger are constructed to verify RSL programs generated by the LLM and provide error feedback to the LLM for refining the outputs until being verified by the compiler. This provides correctness guarantees for the LLM-generated programs before being offloaded to the robots for execution, significantly enhancing the effectiveness of LLM-powered robotic applications. Experiments demonstrate NRTrans outperforms the existing method under a range of LLMs and tasks, and achieves a high success rate for light-weight LLMs.

机器人控制语言模型代码验证自动化纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。