arXiv:2601.07573econ.THcs.AI2026-01被引 4

解释大模型在相似任务间表现忽好忽坏的现象及其背后机制。

A Model of Artificial Jagged Intelligence

  • 用经济信息模型分析用户如何基于粗略信号判断模型可靠性。
  • 揭示经验误差受检验悖论放大,且规模扩展无法消除局部波动。
  • 适合关注模型可信度与使用策略的研究者和实践者。

生成式AI系统在看似相近的任务间常表现出极不均衡的性能:对一个提示能出色完成,而仅微调措辞或上下文便可能自信出错。我们称此为人工锯齿智能(AJI)。本文构建了一个可计算的经济模型来解释这一现象,将采纳视为信息问题:用户关心局部可靠性,但通常仅能观测全局质量信号。在一维基线场景中,真实值为粗糙布朗运动,模型已知由泊松过程采样的零散点。模型最优插值,局部误差以后验方差衡量。推导了盲用户采纳阈值,发现经验误差因检验悖论被放大;同时指出缩放定律本质上是更密集覆盖,虽提升平均质量,却无法消除锯齿性。进一步研究掌握与校准:能基于局部不确定性进行条件判断的校准用户,在盲采纳测试失败的领域仍可获得正期望收益。将掌握建模为通过高斯过程回归学习可靠性图谱,得到由信息增益驱动的学习速率界限,阐明何时发现‘模型有效区域’会变得缓慢。最后探讨缩放与可发现性的关系:当校准信号与用户掌握加速挖掘缩放收益时,以及当不透明性使缩放成果实质上不可见时的情形。

原文摘要 · Abstract (English)

Generative AI systems often display highly uneven performance across tasks that appear ``nearby'': they can be excellent on one prompt and confidently wrong on another with only small changes in wording or context. We call this phenomenon Artificial Jagged Intelligence (AJI). This paper develops a tractable economic model of AJI that treats adoption as an information problem: users care about \emph{local} reliability, but typically observe only coarse, global quality signals. In a baseline one-dimensional landscape, truth is a rough Brownian process, and the model ``knows'' scattered points drawn from a Poisson process. The model interpolates optimally, and the local error is measured by posterior variance. We derive an adoption threshold for a blind user, show that experienced errors are amplified by the inspection paradox, and interpret scaling laws as denser coverage that improves average quality without eliminating jaggedness. We then study mastery and calibration: a calibrated user who can condition on local uncertainty enjoys positive expected value even in domains that fail the blind adoption test. Modelling mastery as learning a reliability map via Gaussian process regression yields a learning-rate bound driven by information gain, clarifying when discovering ``where the model works'' is slow. Finally, we study how scaling interacts with discoverability: when calibrated signals and user mastery accelerate the harvesting of scale improvements, and when opacity can make gains from scaling effectively invisible.

大模型可靠性认知偏差可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。