arXiv:2605.26112cs.AIcs.LG2026-05被引 7

Agent AI的瓶颈从模型扩展转向系统架构,需设计可审计、持久、模块化的执行层。

From Model Scaling to System Scaling: Scaling the Harness in Agentic AI

论文配图:From Model Scaling to System Scaling: Scaling the Harness in Agentic AI
图 1 · 摘自论文原文
  • 将基础模型外的执行层视为可设计优化的核心组件,称作‘系统扩缩’。
  • 实证对比显示新架构在记忆管理与技能路由上更高效可靠。
  • 适合关注AI系统安全、可解释性与长期行为的研究者和开发者。

本文探讨了代理型AI的下一个关键瓶颈:系统扩缩,而非仅模型扩缩——即围绕基础模型构建可审计、持久、模块化且可验证的架构。我们称这一转变为‘扩缩系统框架’:将基础模型外的结构化执行层作为设计、评估与优化的一等对象。尽管近期大语言模型使代理具备工具使用、信息检索、记忆维持和长周期任务执行能力,但评估仍以模型为中心,常将记忆、检索、工具调用、编排、验证与治理视为次要实现细节。这种框架已日益不足,因代理性能源于基础模型、记忆底座、上下文构造器、技能路由层、编排循环及验证与治理层之间的交互。这些组件共同构成代理框架,将模型能力转化为长周期代理行为。本文通过三个核心瓶颈——上下文治理、可信记忆与动态技能路由,以及协调约束它们的编排与治理机制,研究系统框架的扩缩。此外,提出一个涵盖轨迹质量、记忆卫生、上下文效率、通信保真度、验证成本与安全演化的基准研究议程。为使讨论具体化,开发了CheetahClaws(https://github.com/SafeRL-Lab/cheetahclaws)——一个原生Python参考框架,并与Claude Code和OpenClaw进行对比。核心主张是:未来代理型AI的进步,将同样依赖于系统设计,而不仅是更强的基础模型。

原文摘要 · Abstract (English)

This paper studies the next major bottleneck in agentic AI as system scaling, not only model scaling: the design of auditable, persistent, modular, and verifiable architectures around foundation models. We refer to this shift as scaling the harness: treating the structured execution layer around a foundation model as a first-class object of design, evaluation, and optimization. Although recent large language models enable agents to use tools, retrieve information, maintain memory, and execute long-horizon workflows, evaluation remains largely model-centric, often reducing agents to final-task success while treating memory, retrieval, tool use, orchestration, verification, and governance as secondary implementation details. This framing is increasingly inadequate because agent performance emerges from the interaction among the foundation model, memory substrate, context constructor, skill-routing layer, orchestration loop, and verification-and-governance layer. Together, these components form the agent harness, which translates model capability into long-horizon agent behavior. We study scaling the harness through three core bottlenecks: context governance, trustworthy memory, and dynamic skill routing, together with the orchestration and governance mechanisms that coordinate and constrain them. We further outline a research agenda for harness-level benchmarks that go beyond one-shot task success to measure trajectory quality, memory hygiene, context efficiency, communication fidelity, verification cost, and safe evolution over time. To make the discussion concrete, we develop CheetahClaws: https://github.com/SafeRL-Lab/cheetahclaws, a Python-native reference harness, and compare it with Claude Code and OpenClaw. Our main claim is that future progress in agentic AI will depend as much on system design as on stronger foundation models.

智能体系统系统架构可验证性长周期任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。