arXiv:2510.09355cs.CL2025-10

用大模型从自然语言自动生成可执行的推理规则,解决认知架构编程难问题。

NL2GenSym: Natural Language to Generative Symbolic Rules for SOAR Cognitive Architecture via Large Language Models

  • 基于检索增强生成与执行反馈循环,实现规则的自动构建与迭代优化。
  • 在水壶问题上规则生成成功率超86%,决策效率达最优解1.98倍且比基线快千倍。
  • 小模型经训练后性能超越大模型,适合资源受限场景下的智能系统开发。

SOAR是一种经典的符号式认知架构,致力于推动通用类人智能体的发展,但其实际应用受限于人工编写规则的繁重工作。大型语言模型(LLMs)为高效生成规则提供了巨大潜力,然而现有研究多集中于概念框架,缺乏扎实的实验验证。为此,我们提出NL2GenSym框架,将大模型与SOAR结合,实现从自然语言到可生成符号规则的自主转换。该框架引入执行-接地的生成-批评机制:基于检索增强生成的自演化领域知识库,生成器提出规则;随后在SOAR环境中即时执行以严格验证正确性;再由反思式生成器进行迭代优化。在专用于水壶问题(WJP)的数据集上,采用Gemini和Qwen系列模型的实验表明,该框架规则生成成功率超过86%。关键成果是生成了新颖启发式规则,使平均求解决策周期仅为最优解的1.98倍,较基线方法提速1000倍。此外,初步实验显示,小参数模型经训练后性能优于大模型。

原文摘要 · Abstract (English)

SOAR, a classic symbol-based cognitive architecture, has been fostering the development of general, human-like intelligent agents. Nevertheless, its practical adoption is hindered by the laborious manual rule coding. Emerging Large Language Models (LLMs) present the immense potential for efficient rules generation. However, there is a critical gap that current research predominantly focuses on conceptual frameworks and lacks robust experimental validation. To bridge this gap, we propose \textit{N}atural \textit{L}anguage to \textit{Gen}erative \textit{Sym}bolic Rules (NL2GenSym), a novel framework that integrates LLMs with SOAR to autonomously produce generative symbolic rules from natural language. Specifically, our framework introduces a novel Execution-Grounded Generator-Critic mechanism. The LLM-based Generator, guided by a Retrieval-Augmented Generation-accessed self-evolving domain knowledge base, proposes rules from natural language. Subsequently, these rules are immediately executed within the SOAR environment to rigorously validate their correctness. Based on this execution-grounded feedback, a reflective LLM-based Critic drives the iterative refinement of these rules. Experiments on our specialized Water Jug Problem (WJP) dataset, utilizing both Gemini and Qwen series models, validate the efficacy of our framework. It achieves a success rate over 86\% in generating rules from natural language. Crucially, the framework also generates novel heuristic rules, reducing average decision cycles for solving the WJP to 1.98 times the optimal solution and 1/1000 of baseline methods. Additionally, our initial experiments show that NL2GenSym enables smaller-parameter models to achieve better performance than larger counterparts.

认知架构规则生成大模型应用智能推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。