用AI和符号计算联手破解奥数不等式难题
Proving Olympiad Inequalities by Synergizing LLMs and Symbolic Reasoning
- 分治策略:符号方法管缩放,大模型负责改写
- 在161道奥数题上超越现有方法,无需额外训练数据
- 适合对数学推理与AI结合感兴趣的读者
大型语言模型(LLMs)可通过生成证明步骤(即战术)在形式化系统中证明数学定理。然而,战术空间庞大且复杂,而形式化证明的训练数据有限,这对基于LLM的战术生成构成重大挑战。为此,我们提出一种神经符号战术生成器,将LLMs所学的数学直觉与符号方法编码的领域专知相结合。关键在于区分哪些数学推理环节更适合由LLM处理,哪些应由符号方法承担。尽管该集成思路可广泛应用于各类数学问题,本文聚焦于奥数不等式(如图1所示)。我们分析人类解题方式,提炼出两类战术:(1) 缩放由符号方法处理,(2) 改写由LLMs完成。此外,我们将符号工具与LLMs结合,用于剪枝和排序证明目标,实现高效的证明搜索。我们在来自多个数学竞赛的161道高难度不等式上评估该框架,达到当前最优性能,显著优于现有LLM与符号方法,且无需额外训练数据。
原文摘要 · Abstract (English)
Large language models (LLMs) can prove mathematical theorems formally by generating proof steps (\textit{a.k.a.} tactics) within a proof system. However, the space of possible tactics is vast and complex, while the available training data for formal proofs is limited, posing a significant challenge to LLM-based tactic generation. To address this, we introduce a neuro-symbolic tactic generator that synergizes the mathematical intuition learned by LLMs with domain-specific insights encoded by symbolic methods. The key aspect of this integration is identifying which parts of mathematical reasoning are best suited to LLMs and which to symbolic methods. While the high-level idea of neuro-symbolic integration is broadly applicable to various mathematical problems, in this paper, we focus specifically on Olympiad inequalities (Figure~1). We analyze how humans solve these problems and distill the techniques into two types of tactics: (1) scaling, handled by symbolic methods, and (2) rewriting, handled by LLMs. In addition, we combine symbolic tools with LLMs to prune and rank the proof goals for efficient proof search. We evaluate our framework on 161 challenging inequalities from multiple mathematics competitions, achieving state-of-the-art performance and significantly outperforming existing LLM and symbolic approaches without requiring additional training data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。