arXiv:2412.16260cs.LGcs.CC2024-12

对比推理与效率,发现提升模型性能常以牺牲计算效率为代价。

Inference Scaling vs Reasoning: An Empirical Analysis of Compute-Optimal LLM Problem-Solving

  • 结合两种不同优化目标的模型,测试其协同效果。
  • 联合使用后准确率降至9.38%,运行时间143.66秒,性能反而下降。
  • 提示需设计新架构来平衡推理深度与计算效率,适合做模型优化的研究者参考。

近期大语言模型的发展主要聚焦于提升准确率和推理能力,常忽视计算效率。尽管准确率显著提升,但高计算开销和延迟使其难以实际部署。本文通过在Mistral-7B模型上对GSM8K数据集进行实证分析,考察了两种相反方法——Quiet-STaR(自教式推理)与REBASE(奖励均衡搜索)的融合潜力。结果表明:Quiet-STaR虽准确率高达32.03%,但耗时554.66秒,消耗12.73T FLOPs;REBASE则仅需8.47秒、2.35T FLOPs,准确率为10.94%,接近基线。二者结合后准确率骤降至9.38%,耗时143.66秒,性能反而恶化,揭示出推理深度与计算效率之间存在深层矛盾。研究强调需设计新型架构与算法,以弥合二者差距,为未来高效推理方法提供具体方向。

原文摘要 · Abstract (English)

Recent advances in large language models (LLMs) have predominantly focused on maximizing accuracy and reasoning capabilities, often overlooking crucial computational efficiency considerations. While this approach has yielded impressive accuracy improvements, it has led to methods that may be impractical for real-world deployment due to computational overhead and latency constraints. This paper investigates the potential synergy between reasoning enhancement and computational efficiency by analyzing the integration of two contrasting approaches: Quiet-STaR (Self-Taught Reasoner) and REBASE (REward BAlanced SEarch). Through comprehensive empirical analysis using the Mistral-7B model on the GSM8K dataset, we demonstrate that while each method excels in its primary objective-Quiet-STaR achieving superior accuracy (32.03%) despite high computational cost (554.66s runtime, 12.73T FLOPs), and REBASE providing exceptional efficiency (8.47s runtime, 2.35T FLOPs) while maintaining baseline-comparable accuracy (10.94%)-their integration reveals fundamental challenges in reconciling reasoning depth with computational efficiency. The combined approach unexpectedly results in degraded performance (9.38% accuracy, 143.66s runtime), highlighting critical insights about the complex interplay between reasoning enhancement and efficiency optimization in LLMs. Our findings illuminate the need for novel architectures and algorithms specifically designed to bridge the gap between these competing objectives, while providing concrete directions for future research in compute-efficient reasoning methods.

大模型推理优化计算效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。