arXiv:2603.23971cs.CLcs.AI2026-03被引 4

便宜的推理模型实际花费可能更高,成本差异可达28倍。

The Price Reversal Phenomenon: When Cheaper Reasoning Models Cost More

  • 用谢帕利值框架分析成本构成,发现思考令牌和交互轮次差异巨大。
  • 32%情况下低价模型实际成本更高,最高贵28倍,如Gemini 3 Flash贵38%。
  • 相同查询多次运行成本波动达9.7倍,预测成本极难,需新范式。

开发者和用户常依据列出的API价格选择推理模型(RMs),但这些价格是否真实反映实际推理成本?我们首次系统性研究了这一问题,评估了8个前沿推理模型在12种多样化任务上的表现,涵盖竞赛数学、科学问答、代码生成及多领域智能体。我们发现了定价反转现象:在32%的模型对比中,标价更低的模型实际总成本反而更高,反转幅度最高达28倍。例如,Gemini 3 Flash的标价比GPT-5.4低80%,但在所有任务中的实际成本却高出38%。我们构建基于谢帕利值的成本归因框架,揭示了思维令牌消耗与交互轮次高度异质性的根源:同一查询下,不同模型的思考令牌使用量可相差900%,环境交互轮次可差10倍。进一步发现,单个查询的成本预测极为困难:相同查询重复运行时,思考令牌波动高达9.7倍,证明存在不可消除的噪声底限。因此,我们提出成本分布预测作为开放挑战。研究表明,标价不能作为实际成本的可靠代理,亟需成本感知的模型选型与透明的按请求成本监控。

原文摘要 · Abstract (English)

Developers and consumers increasingly choose reasoning models (RMs) based on their listed API prices. However, how accurately do these prices reflect actual inference costs? We conduct the first systematic study of this question, evaluating 8 frontier RMs across 12 diverse tasks covering competition math, science QA, code generation, and multi-domain agents. We uncover the pricing reversal phenomenon: in 32% of model-pair comparisons, the model with a lower listed price actually incurs a higher total cost, with reversal magnitude reaching up to 28x. For example, Gemini 3 Flash's listed price is 80% cheaper than GPT-5.4's, yet its actual cost across all tasks is 38% higher. We build a formal cost attribution framework based on Shapley value, and leverage it to trace the dominating contributors to vast heterogeneity in thinking token consumption and number of interaction turns: on the same query, one model may use 900% more thinking tokens than another, or 10x more turns of environment interactions. We further show that per-query cost prediction is fundamentally difficult: repeated runs of the same query yield thinking token variation up to 9.7x, establishing an irreducible noise floor for any predictor. Thus, we propose cost distribution prediction as an open challenge. Our findings demonstrate that listed API pricing is an unreliable proxy for actual cost, calling for cost-aware model selection and transparent per-request cost monitoring.

推理模型成本分析定价反转成本预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。