arXiv:2509.24377cs.AI2025-09被引 3

让大模型先选策略再解题,提升数学推理的准确与效率

Plan before Solving: Problem-Aware Strategy Routing for Mathematical Reasoning with LLMs

  • 先分析题目特点,动态选择最合适的解题策略
  • 在5个基准上提升0.9%至7.6%,尤其对不同模型效果显著
  • 适合追求高精度数学推理的开发者和研究者

现有方法通常使用固定策略(如自然语言推理、代码增强、工具集成或集成推理)引导大模型进行数学推理。我们分析发现,单一策略难以适配问题特性,忽略效率与效果的权衡。为此,提出PRISM框架,将数学推理拆分为策略规划与针对性执行两阶段。首先构建多策略偏好数据集MathStrat,记录每道题-策略组合的正确性、过程质量与计算效率;然后训练轻量级策略适配器,获得四种策略的置信度分布。推理时,自适应路由策略根据置信度动态调整:高置信度用单策略执行,竞争场景采用双策略验证,不确定情况则开展多策略探索。在五个数学推理基准上的实验表明,PRISM持续优于单一策略与集成基线,不同基础模型下提升0.9%至7.6%。该自适应路由机制在多种模型架构中表现优异。代码已开源。

原文摘要 · Abstract (English)

Existing methods usually leverage a fixed strategy, such as natural language reasoning, code-augmented reasoning, tool-integrated reasoning, or ensemble-based reasoning, to guide Large Language Models (LLMs) to perform mathematical reasoning. Our analysis reveals that the single strategy cannot adapt to problem-specific requirements and thus overlooks the trade-off between effectiveness and efficiency. To address these issues, we propose Planning and Routing through Instance-Specific Modeling (PRISM), a novel framework that decouples mathematical reasoning into two stages: strategy planning and targeted execution. Specifically, we first curate a multi-strategy preference dataset, which we call MathStrat, capturing correctness, process quality, and computational efficiency for each problem--strategy pair. Then, we train a lightweight Strategy Adapter based on the dataset to obtain confidence distributions over the mentioned four reasoning strategies. At inference time, an adaptive routing policy dynamically tailors the reasoning approach based on predictor confidence. It directs the model to use single-strategy execution for high-confidence predictions, dual-strategy verification for competitive scenarios, or comprehensive multi-strategy exploration for uncertain cases. Extensive experiments across five mathematical reasoning benchmarks demonstrate that PRISM consistently outperforms individual strategies and ensemble baselines, achieving improvements ranging from 0.9% to 7.6% across different base models. The adaptive routing approach shows particularly strong benefits for mathematical reasoning tasks across diverse model architectures. Our code is released at https://github.com/reml-group/PRISM.

数学推理策略路由大模型优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。