arXiv:2603.20334cs.SEcs.AI2026-03被引 1

用逻辑推理框架让大模型自动修正抽象规则,提升答题准确率。

Procedural Refinement by LLM-driven Algorithmic Debugging for ARC-AGI-2

  • 将大模型生成的程序视为可验证假设,用逻辑回溯法逐层检查推理过程
  • 在ARC-AGI-2上达到98.33%的通过率,远超普通方法
  • 适用于多种抽象推理任务,尤其适合需要严谨逻辑验证的场景

在高复杂度的抽象推理中,系统需从少量示例或结构化观察中推断潜在规则并应用于未见实例。大模型虽能将规则表达为程序,但常规对话式优化仅关注结果正确性,缺乏对推理过程的正式回溯。本文提出基于归纳推理的程序化精炼(ABPR),结合大模型与Prolog元解释器,将每个候选程序视为潜在规则的可执行命题,并将其SLD目标-子目标求解过程重构为紧凑的证明树结构,遵循Shapiro的算法调试(APD)框架。在此视角下,精炼不仅是代码级调试,更是对模型所假设规则的语义再验证。我们在ARC-AGI-2这一具有挑战性的少样本抽象规则归纳基准(网格变换任务)上评估了该方法。使用Gemini-3-Flash时,ABPR达到56.67% Pass@2;而使用GPT-5.5 xHigh时,在公开测试集上达到98.33% Pass@2。补充实验在填空式I-RAVEN-X及A-I-RAVEN变体上表明,该追踪引导框架可扩展至RAVEN风格的关系与类比抽象任务。重复运行与敏感性分析显示,平行追踪引导搜索随搜索广度与总深度增加,显著降低随机波动。

原文摘要 · Abstract (English)

In high-complexity abstract reasoning, a system must infer a latent rule from a few examples or structured observations and apply it to unseen instances. LLMs can express such rules as programs, but ordinary conversation-based refinement is largely outcome-level: it observes that an answer or output is wrong without formally re-checking which abstraction, relation, or transformation justified that outcome. We propose \emph{Abduction-Based Procedural Refinement} (ABPR), a neuro-symbolic refinement approach that couples an LLM with a Prolog meta-interpreter. ABPR treats each candidate program as an executable declarative hypothesis of the latent rule and reifies its SLD goal--subgoal resolution into compact proof-tree-style derivations, following Shapiro's algorithmic program debugging (APD). In this view, refinement is not merely code-level debugging, but semantic re-checking of the model's hypothesised rule. We evaluate ABPR primarily on ARC-AGI-2, a challenging few-shot abstract rule induction benchmark over grid transformations. ABPR with Gemini-3-Flash achieves 56.67\% Pass@2, while GPT-5.5 xHigh with ABPR reaches 98.33\% Pass@2 on the public evaluation set. Supplementary experiments on fill-in-the-blank I-RAVEN-X and A-I-RAVEN adaptations provide evidence that the same trace-guided framework extends beyond ARC-specific grid tasks to RAVEN-style relational and analogical abstraction. Repeated-run and sensitivity analyses show that parallel trace-guided search reduces stochastic variance as search breadth and total search depth increase.

抽象推理程序精炼逻辑验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。