用大模型+OPC UA实现自然语言控制工业设备,无需触控。
Beyond touch-based human-machine interface: Control your machines in natural language by utilizing large language models and OPC UA
- 大模型调用工具通过OPC UA与设备通信,理解自然语言指令
- 测试中闭源模型准确率达96.0%~98.0%,开源模型达90.0%
- 无需微调,仅需设备凭证和参数字典,通用性强
本文提出一种基于代理的自然人机交互方法,利用具备工具调用能力的大语言模型与工业通信标准OPC UA结合,实现通过自然语言控制机器。相比当前主流的触控交互,该方法允许操作员以语音或文本方式下达指令,如'请将设备1温度降低20%,并启动设备2的清洗操作'。大语言模型接收用户输入后,从三个预定义工具中选择一个连接OPC UA服务器,读取或修改节点值;执行结果返回模型后,生成最终回复。该方法通用性强,适用于所有支持OPC UA的设备。大模型无需微调或训练数据,仅需在系统提示中加入设备凭证和参数字典。在搭载西门子S7-1500可编程逻辑控制器的演示系统上,对五种不同模型进行了50条合成指令测试,闭源GPT-5模型准确率在96.0%至98.0%之间,开源模型最高达90.0%。随后该方案成功部署于实际喷涂涂层设备。该概念有望推动工业领域人机交互向更自然方向发展。
原文摘要 · Abstract (English)
This paper proposes an agent-based approach toward a more natural interface between humans and machines. Large language models equipped with tools and the communication standard OPC UA are utilized to control machines in natural language. Instead of touch interaction, which is currently the state-of-the-art medium for interaction in operations, the proposed approach enables operators to talk or text with machines. This allows commands such as 'Please decrease the temperature by 20 % in machine 1 and start the cleaning operation in machine 2.' The large language model receives the user input and selects one of three predefined tools that connect to an OPC UA server and either change or read the value of a node. Afterwards, the result of the tool execution is passed back to the language model, which then provides a final response to the user. The approach is universally designed and can therefore be applied to any machine that supports the OPC UA standard. The large language model is neither fine-tuned nor requires training data, only the relevant machine credentials and a parameter dictionary are included within the system prompt. The tool-calling ability and their design is evaluated on a demonstrator setup with a Siemens S7-1500 programmable logic controller with four machine parameters. Fifty synthetically generated commands on five different models were tested and the results demonstrate high success rate, with proprietary GPT-5 models achieving accuracies between 96.0 % and 98.0 %, and open-weight models reaching up to 90.0 %. Afterwards the approach was transferred to a deployed spay-coating machine. The proposed concept is supposed to contribute in advancing natural interaction in industrial human-machine interfaces.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。