arXiv:2604.04233cs.ROcs.CL2026-04中稿 · ASME MSEC2026

用语法约束让大模型精准理解工业机器人指令

Precise Robot Command Understanding Using Grammar-Constrained Large Language Models

  • 结合语法引擎与微调大模型,输出标准化机器人可读指令
  • 在HuRIC数据集上命令有效率显著优于基线方法
  • 适合需要高精度指令解析的工业人机协作场景

工业场景中的人机协作需要精确可靠的沟通以提升效率。尽管大语言模型(LLM)能理解通用语言,但往往缺乏执行工业指令所需的领域严格性。本文提出一种语法约束型混合模型,将语法驱动的自然语言理解系统与微调后的LLM结合,兼顾对话灵活性与机器人指令的确定性精度。方法采用两阶段流程:首先由微调的LLM进行高层语境推理与参数推断;其次通过结构化语言模型(SLM)和基于语法的标准化器,强制输出转化为包含有效动作帧和指令元素的标准符号格式。该过程确保生成指令为合法且可被机器人识别的JSON格式。关键创新在于引入验证反馈循环:语法解析器对输出进行校验,若指令无效则自动生成修正提示并重新调用LLM。此迭代自纠正机制可从初始误解中恢复,增强系统鲁棒性。在人类-机器人交互语料库(HuRIC)数据集上的评估表明,该混合方法在命令有效性方面优于两个基线模型——基于API的微调LLM与独立语法驱动的NLU模型,推动更安全高效的工业人机协作。

原文摘要 · Abstract (English)

Human-robot collaboration in industrial settings requires precise and reliable communication to enhance operational efficiency. While Large Language Models (LLMs) understand general language, they often lack the domain-specific rigidity needed for safe and executable industrial commands. To address this gap, this paper introduces a novel grammar-constrained LLM that integrates a grammar-driven Natural Language Understanding (NLU) system with a fine-tuned LLM, which enables both conversational flexibility and the deterministic precision required in robotics. Our method employs a two-stage process. First, a fine-tuned LLM performs high-level contextual reasoning and parameter inference on natural language inputs. Second, a Structured Language Model (SLM) and a grammar-based canonicalizer constrain the LLM's output, forcing it into a standardized symbolic format composed of valid action frames and command elements. This process guarantees that generated commands are valid and structured in a robot-readable JSON format. A key feature of the proposed model is a validation and feedback loop. A grammar parser validates the output against a predefined list of executable robotic actions. If a command is invalid, the system automatically generates corrective prompts and re-engages the LLM. This iterative self-correction mechanism allows the model to recover from initial interpretation errors to improve system robustness. We evaluate our grammar-constrained hybrid model against two baselines: a fine-tuned API-based LLM and a standalone grammar-driven NLU model. Using the Human Robot Interaction Corpus (HuRIC) dataset, we demonstrate that the hybrid approach achieves superior command validity, which promotes safer and more effective industrial human-robot collaboration.

机器人指令大模型语法约束人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。