arXiv:2605.30245cs.CL2026-05

先搞清问题再解题,让大模型更准地做数学推理。

Knowing What to Solve Before How: Preplan Empowered LLM Mathematical Reasoning

  • 增加预规划阶段,明确问题类型和解法工具
  • 在5个数学基准上39/40指标超越基线
  • 无需额外推理开销,适合追求高精度的推理场景

当前基于规划的推理方法通过在执行前插入规划阶段提升大语言模型表现,形成‘问题→规划→思维链’范式。然而深入分析发现,规划与执行阶段均关注‘如何解题’,而忽视了‘该解决什么问题’这一根本前提——即识别问题类型、可用工具及潜在陷阱。为此,本文提出PPC(Preplan-Plan-CoT)框架,引入显式的预规划阶段,构建新范式:‘问题→预规划→规划→思维链’。为保障预规划概念完整性,设计三阶段合成流水线,结合漏泄检测器过滤信息泄露与失败样本,以生成纯净预规划监督信号;并采用复合GRPO奖励机制,确保生成的规划确实源自预规划。在四个模型架构和五个数学推理基准上的实验表明,PPC在40项指标中取得39项最优,较最强基线在maj@16和pass@16上分别提升+2.23和+3.06,且不增加推理阶段的令牌开销。

原文摘要 · Abstract (English)

Current plan-based reasoning methods improve large language models (LLMs) by inserting a planning stage before execution, giving rise to the question $\rightarrow$ plan $\rightarrow$ cot paradigm. While effective, a closer examination reveals an inherent paradigm-level gap: both the planning and its execution stages decide how to solve a problem, while the prior question of what to solve; recognizing the problem type, the applicable tools, and the foreseeable pitfalls; remains entirely implicit. To bridge this gap, we propose PPC (Preplan-Plan-CoT), a framework that introduces an explicit problem-understanding stage, the preplan, yielding a new question $\rightarrow$ preplan $\rightarrow$ plan $\rightarrow$ cot paradigm. Realizing this paradigm requires safeguarding the conceptual integrity of preplan at both ends. Specifically, we design a three-stage synthesis pipeline with a spoiler-score detector that filters out leakage and spoiler failures to build clean preplan supervision, and a composite GRPO reward enforces that the generated plan genuinely follows from the preplan. Experiments across four backbones and five mathematical reasoning benchmarks show that PPC achieves the best results on 39 of 40 metrics, improving maj@16 and pass@16 by +2.23 and +3.06 over the strongest baseline without introducing additional inference token overhead.

数学推理大模型规划生成推理增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。