arXiv:2608.22793cs.CLcs.AI2026-08

让大模型代理稳定可靠,自动优化对话技能库。

TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents

论文配图:TRACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents
图 1 · 摘自论文原文
  • 构建可自进化技能库,通过对比成功失败行为迭代优化
  • 在车载助手任务中将一致表现率从59.9%提升至94.5%
  • 适合追求高可靠性智能体的开发者与产品团队

面向用户产品的可靠部署不依赖于模型的解题能力,而在于一致性与限界感知:即在多次尝试中保持行为一致,并识别出无法或不应安全处理的请求。CAR-bench揭示了车载助手领域中的这一可靠性差距:由大模型模拟的用户发出不完整或模糊请求,要求代理通过多轮对话和工具调用化解不确定性,同时严格遵守领域规则。即使前沿模型在单次尝试中(Pass@3)表现良好,但在多次重复中的一致性表现(Pass^k)仍有显著差距。本文提出TRACE(TRAjectory-Contrastive Evolution),通过非参数化方式迭代改进基于技能的代理行为知识,无需修改模型权重。该知识以模块化、可检索的技能库形式组织,每个技能封装一组独立的工具使用规则与行为准则。TRACE通过代理自进化循环实现技能库演化:每轮评估后,按所调用技能分组轨迹,并通过对比成功与失败行为精炼每项技能。更新后的技能库指导后续评估,部署时代理在每一轮执行状态条件下的技能编排。在GPT-5.5上,TRACE使一致性表现(Pass^3)提升34.6个百分点,从59.9%增至94.5%,潜在性能与可靠性能差距缩小至仅4.0点。在官方隐藏测试集上,使用GPT-5.6-Sol的TRACE获得第一名,达到70%的Pass^3得分,相较基线相对提升40%。结果表明,TRACE能有效将模型潜力转化为稳定可靠的性能。

原文摘要 · Abstract (English)

Reliable deployment of LLM agents in user-facing products depends not on raw task-solving ability but on consistency and limit-awareness: behaving the same way across repeated trials, and recognizing when a request cannot, or cannot yet, be safely fulfilled. CAR-bench exposes this reliability gap in the domain of in-car assistants: an LLM-simulated user issues incomplete or ambiguous requests, requiring the agent to resolve uncertainty through multi-turn dialogue and tool use while strictly adhering to domain policies. Even frontier models show a substantial gap between what they can solve at least once (Pass@3) and what they solve consistently across trials (Pass^k). We bridge this gap with TRACE (TRAjectory-Contrastive Evolution), which iteratively improves a skill-based agent's behavioral knowledge without modifying model weights. This knowledge is organized as a Skill Bank of modular, retrievable skills, each encoding a self-contained set of tool-use rules and behavioral guidelines. TRACE evolves this bank through an agentic self-evolution loop: after each evaluation round, it groups trajectories by the skills invoked and refines each skill by contrasting successful and failed behaviors. The updated bank then guides subsequent rounds, while during deployment the Actor performs state-conditioned skill orchestration at every turn. On GPT-5.5, TRACE improves consistency (Pass^3) by 34.6 points, from 59.9% to 94.5%, while shrinking the gap between potential and reliable performance to just 4.0 points. On the official hidden set, TRACE achieved first place using GPT-5.6-Sol, attaining a Pass^3 score of 70%-a 40% relative improvement over the baseline. These results show that TRACE converts high model potential into stable, consistent performance gain. Project homepage: https://darwin-agent.github.io/Car-bench-TRACE.

大模型代理技能库一致性自进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。