用双层框架把自然语言转为可执行逻辑,提升大模型推理准确性。
From Language to Logic: A Bi-Level Framework for Structured Reasoning
- 分两阶段:先抽象问题类型与约束,再生成可执行逻辑流程。
- 在多个基准上准确率最高提升40%,优于现有方法。
- 适合需要可解释推理的场景,如数学求解与逻辑判断。
自然语言中的结构化推理仍是人工智能的核心挑战,需弥合非结构化语言表达与形式化逻辑表示之间的鸿沟。本文提出一种新颖的双层框架,通过两级过程实现从语言到逻辑的映射:上层由大语言模型(LLM)将自然语言查询解析为中间结构化表示,包含问题类型、目标、决策变量和符号约束;下层则利用这些表示生成符号工作流或可执行推理程序,实现精准且可解释的决策。该框架支持模块化推理,显式约束建模,并可在数学问题求解、问答与逻辑推理等多领域泛化。我们进一步采用端到端双层优化方法,联合优化高层抽象与低层逻辑生成阶段。在多个真实推理基准上的实验表明,该方法显著优于现有基线,准确率最高提升达40%。此外,双层设计增强了透明度与错误可追溯性,为可信、系统的大型语言模型推理提供了可行路径。
原文摘要 · Abstract (English)
Structured reasoning over natural language inputs remains a core challenge in artificial intelligence, as it requires bridging the gap between unstructured linguistic expressions and formal logical representations. In this paper, we propose a novel \textbf{bi-level framework} that maps language to logic through a two-stage process: high-level task abstraction and low-level logic generation. At the upper level, a large language model (LLM) parses natural language queries into intermediate structured representations specifying the problem type, objectives, decision variables, and symbolic constraints. At the lower level, the LLM uses these representations to generate symbolic workflows or executable reasoning programs for accurate and interpretable decision making. The framework supports modular reasoning, enforces explicit constraints, and generalizes across domains such as mathematical problem solving, question answering, and logical inference. We further optimize the framework with an end-to-end {bi-level} optimization approach that jointly refines both the high-level abstraction and low-level logic generation stages. Experiments on multiple realistic reasoning benchmarks demonstrate that our approach significantly outperforms existing baselines in accuracy, with accuracy gains reaching as high as 40\%. Moreover, the bi-level design enhances transparency and error traceability, offering a promising step toward trustworthy and systematic reasoning with LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。