提出轻量级推理框架,用12%算力实现同等定理证明性能。
EconProver: Towards More Economical Test-Time Scaling for Automated Theorem Proving
- 动态切换思维链减少无效词元消耗
- 用可训练前缀的强化学习提升有限采样下的成功率
- 适合资源受限场景下的高效定理证明部署
大型语言模型在自动定理证明领域取得进展,主要依赖测试时扩展策略,如反思式思维链(CoT)和增加采样次数。但这些方法带来显著计算开销。现有成本分析仅关注采样次数,忽略不同策略间的采样成本差异。本文系统比较了多种测试时扩展策略的效率,揭示当前开源最优方法存在效率不足问题。为此,提出两种互补方法:(1) 动态思维链切换机制,减少不必要的词元使用;(2) 带可训练前缀的多样并行强化学习,提升受限采样次数下的成功概率。在miniF2F和ProofNet上的实验表明,EconProver在仅需12%计算成本的情况下,达到与基线相当的性能。该工作为低耗高效定理证明模型部署提供实用指导。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have recently advanced the field of Automated Theorem Proving (ATP), attaining substantial performance gains through widely adopted test-time scaling strategies, notably reflective Chain-of-Thought (CoT) reasoning and increased sampling passes. However, they both introduce significant computational overhead for inference. Moreover, existing cost analyses typically regulate only the number of sampling passes, while neglecting the substantial disparities in sampling costs introduced by different scaling strategies. In this paper, we systematically compare the efficiency of different test-time scaling strategies for ATP models and demonstrate the inefficiency of the current state-of-the-art (SOTA) open-source approaches. We then investigate approaches to significantly reduce token usage and sample passes while maintaining the original performance. Specifically, we propose two complementary methods that can be integrated into a unified EconRL pipeline for amplified benefits: (1) a dynamic Chain-of-Thought (CoT) switching mechanism designed to mitigate unnecessary token consumption, and (2) Diverse parallel-scaled reinforcement learning (RL) with trainable prefixes to enhance pass rates under constrained sampling passes. Experiments on miniF2F and ProofNet demonstrate that our EconProver achieves comparable performance to baseline methods with only 12% of the computational cost. This work provides actionable insights for deploying lightweight ATP models without sacrificing performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。