arXiv:2608.10843cs.AI2026-08

用验证器引导大模型与符号搜索,提升一阶归纳推理准确率

Hypothesis Frontier: Verifier Guided LLM and Symbolic Search for First-Order Induction

  • 通过验证器逐个检查大模型生成的公式,保留最强有效假设
  • 在相同条件下解决的问题比重复生成多40%以上
  • 可对结果公式进行精确简化,不改变训练预测

一阶概念合成要求系统在多个有限关系结构中推断出一个能一致分类标注对象的公式。每个候选公式可被精确评估,但一阶公式构成庞大的搜索空间,大模型输出常语义合理却不够准确。本文提出Hypothesis Frontier,一种验证器引导的神经符号框架:在每轮中对每个训练对象评估大模型公式,保留最强已验证假设,并利用剩余错误指导后续生成。符号处理修复无效公式,同时保持与大模型生成假设的一致性,并在不改变任何训练预测的前提下简化训练-验证公式。在相同模型、问题集和大模型轮次预算下,该方法解决的问题显著多于重复原始提示生成。最终选出公式后,精确符号化简化可压缩多数训练-验证公式。精确符号推理既提升了归纳问题求解率,也实现了公式压缩。

原文摘要 · Abstract (English)

First-order concept synthesis asks a system to infer one formula that classifies labeled objects consistently across several finite relational structures. Every candidate can be evaluated exactly, but quantified first-order formulas form a vast search space, and LLM outputs are often semantically promising without being fully correct. We introduce Hypothesis Frontier, a verifier-guided neurosymbolic framework that evaluates each LLM formula on every training object, retains the strongest verified hypothesis across rounds, and uses its remaining errors to guide subsequent generation. Symbolic processing repairs invalid formulas while remaining anchored to the LLM-generated hypothesis, and simplifies train-valid formulas without changing any training prediction. Under matched models, problem sets, and LLM-round budgets, Hypothesis Frontier solves substantially more problems than repeated original-prompt generation. After the final formulas are selected, exact simplification shortens many train-valid formulas while preserving every training prediction. Exact symbolic reasoning therefore helps both to solve more induction problems and to compress many of the resulting formulas.

一阶逻辑大模型推理符号搜索形式化验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。