arXiv:2502.16529cs.CLcs.AI2025-02ACL被引 4

用检索增强+偏好优化,提升工业编程生成准确率超10%。

Retrieval-Augmented Fine-Tuning With Preference Optimization For Visual Program Generation

  • 先检索子程序,再用偏好优化引导模型生成
  • 在真实梯形图数据上准确率提升超10%
  • 适合工业自动化领域需要高精度代码生成的场景

视觉编程语言(VPL)通过图形界面降低编程门槛,广泛应用于各领域。现有研究多用大语言模型基于提示生成VPL代码,但对工业级语言如梯形图(LD)效果有限,因其涉及大量领域特定配置,难以通过单个提示捕捉。本文发现,基于训练的方法即使使用较小模型,也优于提示法。为此提出两阶段训练策略:首先采用检索增强微调,利用工业VPL中常见的子程序重复特性;其次应用直接偏好优化(DPO),通过图编辑操作构建系统化偏好对,引导模型输出更准确代码。在真实梯形图数据上的实验表明,该方法相较监督微调,程序级准确率提升超过10%,展现了在工业自动化中的应用潜力。

原文摘要 · Abstract (English)

Visual programming languages (VPLs) allow users to create programs through graphical interfaces, which results in easier accessibility and their widespread usage in various domains. To further enhance this accessibility, recent research has focused on generating VPL code from user instructions using large language models (LLMs). Specifically, by employing prompting-based methods, these studies have shown promising results. Nevertheless, such approaches can be less effective for industrial VPLs such as Ladder Diagram (LD). LD is a pivotal language used in industrial automation processes and involves extensive domain-specific configurations, which are difficult to capture in a single prompt. In this work, we demonstrate that training-based methods outperform prompting-based methods for LD generation accuracy, even with smaller backbone models. Building on these findings, we propose a two-stage training strategy to further enhance VPL generation. First, we employ retrieval-augmented fine-tuning to leverage the repetitive use of subroutines commonly seen in industrial VPLs. Second, we apply direct preference optimization (DPO) to further guide the model toward accurate outputs, using systematically generated preference pairs through graph editing operations. Extensive experiments on real-world LD data demonstrate that our approach improves program-level accuracy by over 10% compared to supervised fine-tuning, which highlights its potential to advance industrial automation.

视觉编程梯形图偏好优化工业自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。