arXiv:2605.00798cs.LGcs.CL2026-05被引 1

让AI按自然语言计划执行任务,还能自动纠错

RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Execution

论文配图:RunAgent: Interpreting Natural-Language Plans with Constraint-Guided Execution
图 1 · 摘自论文原文
  • 用带控制语句的代理语言解析自然语言计划
  • 在两个数据集上准确率显著优于现有方法
  • 适合需要可靠自动化流程的科研与工程场景

人类通过执行特定计划解决问题,但大语言模型在结构化工作流执行中仍不可靠。我们提出RunAgent,一个多代理计划执行平台,能够解释自然语言计划,并通过约束和评分标准强制步骤式执行。RunAgent通过具有显式控制结构(如IF、GOTO、FORALL)的代理语言,将自然语言的表达力与编程的确定性相结合。除了基于每一步指令进行语法和语义验证外,RunAgent还自主推导并验证每个步骤的任务描述和实例相关的约束。它动态选择使用LLM推理、工具调用或代码生成执行(如Python),并集成错误纠正机制以确保正确性。最后,RunAgent在每步执行时仅保留相关上下文信息,实现高效过滤。在Natural-plan和SciBench数据集上的评估表明,RunAgent在性能上超越基线LLM和最先进的PlanGEN方法。

原文摘要 · Abstract (English)

Humans solve problems by executing targeted plans, yet large language models (LLMs) remain unreliable for structured workflow execution. We propose RunAgent, a multi-agent plan execution platform that interprets natural-language plans while enforcing stepwise execution through constraints and rubrics. RunAgent bridges the expressiveness of natural language with the determinism of programming via an agentic language with explicit control constructs (e.g., \texttt{IF}, \texttt{GOTO}, \texttt{FORALL}). Beyond verifying syntactic and semantic verification of the step output, which is performed based on the specific instruction of each step, RunAgent autonomously derives and validates constraints based on the description of the task and its instance at each step. RunAgent also dynamically selects among LLM-based reasoning, tool usage, and code generation and execution (e.g., in Python), and incorporates error correction mechanisms to ensure correctness. Finally, RunAgent filters the context history by retaining only relevant information during the execution of each step. Evaluations on Natural-plan and SciBench Datasets demonstrate that RunAgent outperforms baseline LLMs and state-of-the-art PlanGEN methods.

计划执行多代理系统自然语言AI纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。