让智能体技能自动定位故障环节并精准复用外部知识修复
Workflow-Localized Mechanism Learning: Attribution-Guided Repair and Knowledge Reuse for Structured Agent Skills
- 通过机制归因定位失败节点与问题根源,分层调度修复资源
- 在表格任务上达90.33%准确率,跨数据集迁移效果稳定
- 适合需要高可靠性、可解释性智能体系统的研发团队
智能体技能将可复用的程序化知识作为外部构件供冻结语言模型使用,但现有优化器无法同时解决工作流中故障发生位置、导致问题的机制及如何局部复用第三方技能知识的问题。本文提出工作流局部化机制学习(WML),其节点-机制归因技术可识别失败的工作流节点、涉及的机制及最小有效修改目标,将单一机制缺陷路由至L3资源,跨机制关系缺陷则交由L2组合协议处理。六模块工作流引导技能优化(WGSO)循环依次选择来源与范围感知的第三方知识,应用有限修补,评估候选方案,并将验证结果存入优化器侧内存。在SpreadsheetBench上,WML对DeepSeek和Qwen3.6-Flash分别达到90.33±1.53和74.67±3.51的硬准确率;未经额外优化即在WikiTableQuestions上实现84.00±2.00和83.00±2.00的记号准确率。在Compiler-Supported50上,WML获得最高硬通过率且单位成功任务成本最低;编译执行显著降低令牌数与调用次数,同时保留大部分成功任务。代码与资源见https://github.com/xiaolin9595/workflow-localized-mechanism-learning。
原文摘要 · Abstract (English)
Agent Skills package reusable procedural knowledge as external artifacts for frozen language-model agents, yet existing optimizers do not jointly resolve where a failure occurs in a workflow, which mechanism caused it, and how relevant knowledge from third-party Skills should be reused locally. We introduce Workflow-Localized Mechanism Learning (WML). Its Node--Mechanism Attribution identifies the failed workflow node, implicated mechanisms, and smallest valid edit target, routing single-mechanism defects to L3 resources and relational defects across mechanisms to L2 composition protocols. A six-module Workflow-Guided Skill Optimization (WGSO) loop then selects provenance- and scope-aware third-party knowledge, applies bounded patches, evaluates candidates, and stores verified outcomes in optimizer-side memory. On SpreadsheetBench, WML reaches 90.33 +/- 1.53 and 74.67 +/- 3.51 Hard Accuracy with DeepSeek and Qwen3.6-Flash, respectively; without additional optimization, the learned Skills transfer to WikiTableQuestions with 84.00 +/- 2.00 and 83.00 +/- 2.00 Denotation Accuracy. On Compiler-Supported50, WML attains both the highest hard-PASS rate and the lowest cost per successful task; compiled execution sharply reduces tokens and calls relative to a direct SkillAgent while retaining most of its successful tasks. Code and artifacts are available at https://github.com/xiaolin9595/workflow-localized-mechanism-learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。