arXiv:2605.01214cs.AIcs.CY2026-05被引 2

把智能体系统看作逐字成本分配,能发现效率漏洞并改进设计。

Agentic AI Systems Should Be Designed as Marginal Token Allocators

  • 将智能体的路由、决策、生成、训练四层统一为边际成本核算框架
  • 揭示了过度路由、验证不足等常见失效模式的根源
  • 适合关注系统级效率与智能体经济性的研究者和工程师

本文主张将代理型AI系统的设计与评估视为边际令牌分配经济,而非按单元计价的文字生成器。通过追踪一个开发者请求编码代理修复失败测试的场景,分析了四个目前各自独立设计的层面:决定由哪个模型回应的路由器、决定是否规划、执行、验证或延迟的代理、决定如何生成每个令牌的服务栈,以及决定轨迹是否值得学习的训练流水线。我们发现这四个层面都在解决相同的首要条件——边际收益等于边际成本加延迟成本加风险成本,只是索引集和价格不同。该框架刻意保持简约,不提出完整的AI经济学理论。但采用边际令牌分配作为共享核算对象,可解释为何局部最小化令牌导致全局错配,预测出一组重复出现的故障模式(过度路由、过度委派、验证不足、服务拥堵、旧版本部署、缓存误用),并指向具体研究方向:令牌感知评估、自主性定价、拥堵定价服务、风险调整的强化学习预算分配。

原文摘要 · Abstract (English)

This position paper argues that agentic AI systems should be designed and evaluated as \emph{marginal token allocation economies} rather than as text generators priced by the unit. We follow a single request -- a developer asking a coding agent to fix a failing test -- through four economic layers that today are designed in isolation: a router that decides which model answers, an agent that decides whether to plan, act, verify, or defer, a serving stack that decides how to produce each token, and a training pipeline that decides whether the trace is worth learning from. We show that all four layers are solving the \emph{same} first-order condition -- marginal benefit equals marginal cost plus latency cost plus risk cost -- with different index sets and different prices. The framing is deliberately minimal: we do not propose a complete theory of AI economics. But adopting marginal token allocation as the shared accounting object explains why systems that locally minimize tokens globally misallocate them, predicts a small set of recurring failure modes (over-routing, over-delegation, under-verification, serving congestion, stale rollouts, cache misuse), and points to a concrete research agenda in token-aware evaluation, autonomy pricing, congestion-priced serving, and risk-adjusted RL budgeting.

智能体系统经济建模效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。