arXiv:2607.04096cs.AI2026-07

用可验证的程序化推理,让小模型也能达到大模型水平。

Forethought: Verifiable Reasoning from Neurosymbolic Primitive Programming

  • 将推理过程写成可检查的代码,基于符号与神经原语构建
  • 在五个基准上提升基础模型准确率约30%,媲美前沿大模型
  • 适合需要透明、可控推理的场景,如医疗或金融决策

当前智能体工作流通常将用户请求分解为带参数的工具调用序列,并通过语言模型上下文中的推理链处理结果。主流改进方式是测试时扩展,即训练模型搜索长思维链,但该能力嵌入模型权重,无法逐步验证且推理成本高。我们提出 Forethought,一种神经符号推理系统,将推理视为显式的可验证程序,从领域特定语言中组合符号与神经原语构建。生成的推理程序是模型工作的具体表示,可部署前审查和修改。作为工具调用执行内核,在五个基准上评估,相比基础模型提升约30%相对准确率,优于直接提示、强化学习支架和提示进化方法,使小模型匹配甚至超越前沿模型能力。直接对比显示,一个非推理模型搭配 Forethought 即可抗衡专用推理模型,仅需其约千分之一的后期训练投入,且保持模型无关性与可审计性。

原文摘要 · Abstract (English)

Current agentic workflows usually involve decomposing user requests into sequences of tool calls with correctly resolved parameters, the results of which are processed through reasoning traces in the language model's context window. The prevailing route to improve such reasoning is test-time scaling, which trains models to search over long chains of thought; but the resulting capability is entangled in model weights, is not verifiable step-by-step, and is costly at inference. We present Forethought, a neurosymbolic reasoning system that instead treats reasoning as an explicit, verifiable program, that builds from a library of symbolic and neural primitives which are composed through a domain-specific language. The result are reasoning programs, which are concrete representations of the model's work, and as such can be inspected and modified before deployment. Instantiated as a tool-calling execution kernel and evaluated across five benchmarks, Forethought improves base-model accuracy by about 30% relative and outperforms vanilla prompting, reinforcement learning scaffolds, and prompt-evolution methods, enabling small models to match or exceed frontier models capabilities. In a direct comparison, a non-reasoning model augmented with Forethought competes with a dedicated reasoning model while requiring roughly three orders of magnitude less post-training investment, and remains model-agnostic and auditable.

神经符号可验证推理小模型增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。