AI推理价格下降假象:87%降幅被传统方法忽略
The Price of Intelligence: A Quality-Adjusted Price Index for AI Services
- 用基准测试响应模式构建隐含质量指数,修正价格评估
- 调整质量后价格年降幅达0.73对数点,远超原方法的0.10
- 适合关注AI经济效率、政策制定者和量化研究者
自2024年以来,AI推理的标价持续下降,但测量下降速度的方法几乎决定了结果。本文基于公开数据构建了AI推理市场的质量调整价格指数。数据集包含3,208个模型、86个提供商的21,024条标价记录,并通过从基准测试响应模式中估计的潜在质量指数,将这些价格与4,605个基准得分匹配,由此建立基于评估而非产品特性的质量阶梯。采用统计机构用于软件的匹配模型方法,推理价格年均下降0.10对数点;而质量调整后的指数年降幅为0.73,意味着87%的下降在现有方法下不可见,直接影响市场竞争力、集中度和生产率的衡量。若按完成任务计价,买家实际支付价格已停止下降。原因在于推理模型的分词消耗增长快于分词价格下跌,导致买卖双方价格脱节。一项预注册的有效性审计验证了质量度量的可靠性,剔除标记为污染的基准后,模型排名仍保持0.998相关性,但指数变动达0.49对数点/年,说明主流排行榜稳定性无法为基于基准的经济统计提供合理辩护。所有价格、质量与审计结果均可从公开来源零成本复现。
原文摘要 · Abstract (English)
Posted prices for AI inference have fallen steadily since 2024, yet the measured speed of that fall depends almost entirely on the method of measurement. This paper constructs quality-adjusted price indices for the AI inference market from public data. The panel assembles 21,024 posted-price observations across 3,208 models and 86 providers and joins them to 4,605 benchmark scores through a latent quality index estimated from benchmark response patterns, so the quality ladder of the hedonic tradition is built here from evaluations in place of product characteristics. Measured by the matched-model methods that statistical agencies apply to software, inference prices fell at 0.10 log points a year. The quality-adjusted index fell at 0.73, so 87% of the decline is invisible to current methods, with direct consequences for measured competition, concentration and productivity in this market. Counted per completed task, moreover, the buyer's price stopped falling. Reasoning models raised token consumption faster than token prices fell, and the seller's and buyer's prices accordingly diverged. A pre-registered validity audit disciplines the quality measure and yields the sharpest result. Excluding contamination-flagged benchmarks leaves model rankings intact at 0.998 yet moves the index by 0.49 log points a year, so the leaderboard-stability arguments standard in AI evaluation offer no defence of economic statistics built on benchmarks. Prices, quality and the audit are fully reproducible from public sources at zero cost.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。