arXiv:2605.29668cs.AIcs.CL2026-05中稿 · EMNLP被引 5

让大模型自我改进时避免破坏已有能力,提升可靠性。

GRASP: Gated Regression-Aware Skill Proposer for Self-Improving LLM Agents

论文配图:GRASP: Gated Regression-Aware Skill Proposer for Self-Improving LLM Agents
图 1 · 摘自论文原文
  • 通过可验证的编辑机制更新技能库,只接受整体表现提升的修改
  • 在医疗任务中使最强模型准确率从40.6%提升至88.8%,最高提升40.3点
  • 适合有重复结构化任务的环境,尤其适用于临床系统等工具调用场景

在结构化环境中,大型语言模型代理的失败多源于操作而非对话问题,其可靠性依赖于对环境的程序性知识。以往自改进方法仅积累自然语言指导,未验证新增内容是否保留原有正确行为,导致修复一条路径可能意外破坏另一条。本文提出GRASP(门控回归感知技能提议者),将代理改进视为对有限技能库的一系列编辑操作,仅当候选修改在平衡的保留探针上实现净收益且满足硬性回归预算时才被采纳。在两个基于FHIR的临床基准上评估,使用五种基础模型,评分标准为对FHIR状态的程序可靠性,而非临床正确性或患者结果。在MedAgentBench上,GRASP将gpt-oss-120b准确率从40.6%提升至88.8%,超越五个自改进基线中的最强者21.0分,其余所有基础模型均提升17.2至40.3分。消融实验表明,性能提升主要来自比较式提案生成、接受门控和硬性回归预算,而非技能写作本身——无验证的技能写作效果不优于不使用技能。赋予所有基线相同接受门控后,各模型在域内提升,域外无变化,说明增益来自对有限可编辑库的门控机制,而非保留验证本身。该机制适用于任务重复且结构可验证的非临床环境,在动作空间开放时效果平坦。冻结的技能库可在共享工具调用约定的模型与基准间迁移,但在接口不匹配时性能下降。

原文摘要 · Abstract (English)

LLM agents acting in structured environments fail in operational rather than conversational ways, and reliability depends on procedural knowledge of the environment. Prior self-improvement methods accumulate natural-language guidance without checking that each new item preserves previously correct behavior, so a note that fixes one trajectory can silently regress another. We introduce GRASP (Gated Regression-Aware Skill Proposer), which treats agent improvement as a sequence of edits to a bounded skill library, admitting each candidate only if it produces a net improvement on a balanced held-out probe under a hard regression budget. We evaluate GRASP across five base models on two FHIR-based clinical benchmarks, which score procedural reliability against FHIR state rather than clinical correctness or patient outcomes. On MedAgentBench, GRASP lifts gpt-oss-120b from 40.6% to 88.8%, exceeds the strongest of five self-improvement baselines by 21.0 points, and improves every other base model by 17.2 to 40.3 points. Ablations attribute the gain to comparative proposal generation, the acceptance gate, and the hard regression budget rather than to skill writing itself, which without validation is no better than using no skills. Granting the same acceptance gate to all five baselines lifts each of them in-domain and none of them out of distribution, isolating the gain to the gate applied to a bounded, editable library rather than to held-out validation itself. The mechanism helps in non-clinical environments where tasks recur with verifiable structure and is flat where the action space is open-ended. Frozen libraries transfer across models and across benchmarks that share a tool-calling convention and degrade under interface mismatch.

大模型代理自改进技能库医疗AI

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。