arXiv:2507.00004cs.LGcs.AI2025-07被引 7

提出新理论框架,解析大模型推理的算力消耗与效率关系。

A Theory of Inference Compute Scaling: Reasoning through Directed Stochastic Skill Search

  • 将推理建模为技能图上的随机搜索过程,统一分析多种推理策略。
  • 理论推导出任务成功率与算力消耗的闭式表达,匹配实际观测趋势。
  • 揭示推理策略选择受任务难度和模型能力影响,适合算法设计者参考。

大语言模型在训练和部署阶段均需大量计算、能源和资金投入。尽管训练规模定律推动了领域进展,但推理成本已成为资源负担的重要且持续增长的部分,尤其对注重推理的模型而言。现有对算力最优性的刻画若仅孤立或固定组合模型规模、数据集规模和推理词元数,可能忽略更高效的运行点。本文提出定向随机技能搜索(DS3),将推理视为在学习到的技能图上进行的随机遍历。通过一个简化但表达性强的实例,我们推导出各类推理策略(包括思维链CoT和思维树ToT)下任务成功概率与算力成本的闭式表达,实现跨任务难度与模型能力的比较分析。我们将先前基于第一性原理的三元图训练框架扩展至包含推理,并分别将DS3与实证的LLM缩放行为方法衔接。理论上重现了已观测到的现象:准确率随对数算力线性提升;不同任务难度与模型能力下偏好推理策略的变化;即使参数缩放性能趋于饱和,推理仍能激发涌现行为;以及最佳N次采样(BoN)与多数投票行为可在统一框架中捕捉。通过显式刻画训练-推理间的依赖关系,本框架深化了理论理解,支持有原则的算法设计与资源分配。

原文摘要 · Abstract (English)

Large language models (LLMs) demand considerable computational, energy, and financial resources during both training and deployment. While scaling laws for training have guided much of the field's recent progress, inference costs now represent a significant and growing component of the overall resource burden, particularly for reasoning-focused models. Existing characterizations of compute-optimality that consider model size, dataset size, and inference tokens in isolation or in fixed combinations risk overlooking more efficient operating points. We introduce directed stochastic skill search (DS3), a general framework that represents inference as stochastic traversal over a learned skill graph. From a simplified yet expressive instantiation, we derive closed-form expressions for task success and compute cost across a wide range of inference strategies -- including chain-of-thought (CoT) and tree-of-thought (ToT) -- enabling comparative analysis as a function of task difficulty and model capability. To that end, we extend a prior first-principles tripartite graph framework of LLM training to incorporate inference, and separately bridge DS3 with empirical methods that characterize LLM scaling behavior. We theoretically recover empirically observed patterns, including: linear accuracy scaling with logarithmic compute; variation in preferred inference strategies as a function of task difficulty and model capability; emergent behavior elicited by reasoning even when performance plateaus under parameter scaling; and both best-of-N (BoN) and majority voting behavior captured within a unified analytical framework. By explicitly characterizing training-inference interdependencies, our framework deepens theoretical understanding and supports principled algorithmic design and resource allocation.

推理优化算力分析大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。