arXiv:2606.03047cs.ROcs.MA2026-06被引 1

用闭环调试让大模型生成精准机器人控制代码

ModuLoop : Low-Level Code Generation using Modular Synthesizer and Closed-Loop Debugger for Robotic Control

论文配图:ModuLoop : Low-Level Code Generation using Modular Synthesizer and Closed-Loop Debugger for Robotic Control
图 1 · 摘自论文原文
  • 大模型生成代码后实时运行并插入探针调试
  • 在真实场景中实现高精度相机与机械臂校准
  • 无需微调即可自动优化,适合工业级应用

大型语言模型(LLMs)在代码生成和问题求解等任务中表现优异,但在需要精确操控、实时反馈和环境依赖执行的低层机器人控制任务中仍受限。为此,我们提出闭环模块化代码合成框架。该框架利用预训练大模型进行无任务微调的模块化代码规划与生成,并通过插入调试探针持续执行代码、观察行为,形成闭环结构以系统性地调试与优化,最终生成可执行的控制程序。我们在真实场景中应用于RGB-D相机和机械臂的校准任务,验证了其有效性。进一步通过抓取放置任务,不仅展示了校准精度,还证明了框架的可扩展性。两个任务均实现了高执行准确率和自主性,体现了基于该框架的LLM驱动机器人控制在实际应用中的可行性与可扩展性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have demonstrated impressive performance across various domains, including code generation and problem solving. However, their application in robotic control, particularly in low-level tasks that require precise manipulation, real-time feedback, and environment-dependent execution, remains limited. To address this challenge, we propose the Closed-Loop Modular Code Synthesizer framework. This framework leverages a pre-trained LLM without any task-specific fine-tuning to perform modular code planning and generation, and iteratively executes the generated code while inserting debugging probes to observe its behavior. This closed-loop structure facilitates systematic debugging and refinement, ultimately producing executable control programs. We apply the proposed framework to the calibration of an RGB-D camera and a robotic arm, validating its effectiveness in real-world settings. Furthermore, through a subsequent pick-and-place task, we demonstrate not only the accuracy of the calibration but also the potential extensibility of the framework. Across both tasks, the framework achieved high execution accuracy and autonomy, illustrating the practicality and scalability of LLM-based robotic control using our framework.

机器人控制大模型闭环调试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。