arXiv:2604.04898cs.AIcs.CL2026-04被引 3

小模型也能解奥数难题,成本仅为大模型的零头。

QED-Nano: Teaching a Tiny Model to Prove Hard Theorems

  • 用3阶段训练法让40亿参数模型学会写奥数证明。
  • 在奥数题上表现超越更大开源模型,接近闭源顶级水平。
  • 适合研究数学推理、可复现的小模型开发人群。

近期专有AI系统在复杂证明问题上展现出惊人能力,甚至在2025年国际数学奥林匹克(IMO)中达到金牌级表现。然而这些系统训练流程不透明,依赖大型内部模型和辅助结构,导致运行成本高、难以复现与改进。本文提出一个问题:小型开源模型能否也具备竞争性数学推理能力?为此,我们构建了QED-Nano,一个40亿参数的模型,专门用于奥数级证明生成。训练分三步:(1)通过从DeepSeek-Math-V2蒸馏,进行监督微调以获得良好证明写作风格;(2)采用基于评分标准的强化学习;(3)引入推理缓存机制,将长证明分解为逐步总结与优化的循环,提升测试时推理能力。QED-Nano在证明生成性能上超过多个更大开源模型(如Nomos-1和GPT-OSS-120B),并接近闭源模型(如Gemini 3 Pro)的表现,但推理成本仅为后者的极小部分。为支持开放研究,我们公开完整QED-Nano流程,包括QED-Nano与QED-Nano-SFT模型、FineProofs-SFT与FineProofs-RL数据集以及训练与评估代码。

原文摘要 · Abstract (English)

Proprietary AI systems have recently demonstrated impressive capabilities on complex proof-based problems, with gold-level performance reported at the 2025 International Mathematical Olympiad (IMO). However, the training pipelines behind these systems remain largely undisclosed, and their reliance on large "internal" models and scaffolds makes them expensive to run, difficult to reproduce, and hard to study or improve upon. This raises a central question: can small, open models also be trained to achieve competitive reasoning performance on difficult Olympiad-level math? In this paper, we answer this question by building QED-Nano, a 4B model post-trained for Olympiad-level proofs. Our training recipe has three stages: (1) supervised fine-tuning to imbue good proof-writing styles by distilling from DeepSeek-Math-V2, (2) reinforcement learning (RL) with rubric-based rewards, and (3) expanding RL with a reasoning cache, which decomposes long proofs into iterative summarize-and-refine cycles and enables stronger test-time reasoning. QED-Nano surpasses the proof-generation performance of much larger open models, including Nomos-1 and GPT-OSS-120B, and approaches the performance of proprietary models like Gemini 3 Pro, at a fraction of the inference cost. To support further research on open mathematical reasoning, we release the full QED-Nano pipeline, including the QED-Nano and QED-Nano-SFT models, the FineProofs-SFT and FineProofs-RL datasets, and the training and evaluation code.

数学推理小模型强化学习奥数

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。