arXiv:2606.20683cs.AIcs.CL2026-06综述被引 4

厘清大模型与运行框架的协同关系,揭示智能体性能瓶颈根源。

From Question Answering to Task Completion: A Survey on Agent System and Harness Design

论文配图:From Question Answering to Task Completion: A Survey on Agent System and Harness Design
图 1 · 摘自论文原文
  • 将智能体视为模型与执行框架的耦合系统,提出六维运行责任分解
  • 实证表明运行框架设计显著影响长周期任务的完成效率与可靠性
  • 适合关注智能体架构设计、评估方法及模型-系统协同的研究者

基于大模型的智能体标志着从被动问答向主动任务完成的转变:它们能感知环境、调用工具、维护状态,并在长时间跨度上持续行动。随着智能体系统从提示工程演进到工作流、上下文工程、执行框架工程以及模型原生训练的协同进化,核心问题日益凸显:智能体性能的瓶颈究竟存在于基础模型、执行框架,还是二者之间的耦合?本文从模型-框架视角审视基于大模型的智能体。首先明确智能体的功能定义及其实现视图——即基础模型与执行框架的耦合。随后分析模型中心扩展的局限性,梳理智能体工程的四个范式,并将执行框架分解为六个相互关联的运行职责:观察、上下文、控制、动作、状态与验证。基于此分解,将任务特性与领域压力映射到框架配置,回顾基准与评估实践,并综合模型-框架证据,揭示运行时设计对长周期任务完成度、效率与可靠性的影响。最后,指出价值感知评估、安全、框架泛化与模型-框架共进化等开放挑战。本文强调,智能体质量(成功率、效率、安全性、泛化能力)并非来自模型本身,而是由模型能力、运行基础设施、任务结构与评估设计的交互所共同决定。文中讨论的代表性论文集合见 https://github.com/ggjy/Awesome-Agent-Engineering。

原文摘要 · Abstract (English)

LLM-based agents mark a shift from passive question answering to active task completion: they perceive environments, invoke tools, maintain state, and act over extended horizons. As agent systems have evolved from prompt engineering to workflows and context engineering, harness engineering, and agent-native training with co-evolution, a central question has become increasingly important: where does the bottleneck in agent performance reside, in the foundation model, in the execution harness, or in the coupling between them? This survey examines LLM-based agents through a model-harness lens. We first clarify the functional definition of agents and the implementation view of an LLM-based agent as a foundation model coupled with an execution harness. We then analyze the limits of model-centric scaling, trace four paradigms of agent engineering, and decompose the execution harness into six coupled runtime responsibilities: observation, context, control, action, state, and verification. Using this decomposition, we map task properties and domain pressures to harness configurations, review benchmark and evaluation practices, and synthesize model-harness evidence on how runtime design affects long-horizon task completion, efficiency, and reliability. Finally, we identify open challenges in value-aware evaluation, safety, harness generalization, and model-harness co-evolution. Rather than treating agents as models with auxiliary tools, this survey argues that agent quality -- including success, efficiency, safety, and generalization -- emerges from the interaction between model capability, runtime infrastructure, task structure, and evaluation design. A collection of papers discussed in this survey is provided in https://github.com/ggjy/Awesome-Agent-Engineering.

智能体系统运行框架大模型协同任务完成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。