arXiv:2608.22339cs.CL2026-08中稿 · EMNLP

给大模型技能记忆加边界条件,避免盲目模仿导致错误工具调用。

When Not to Imitate: Boundary-Aware Skill Memory for Reliable Tool-Use LLM Agents

论文配图:When Not to Imitate: Boundary-Aware Skill Memory for Reliable Tool-Use LLM Agents
图 1 · 摘自论文原文
  • 为每个技能添加适用条件、风险提示等边界信息,实现有条件调用
  • 在多个基准上提升成功率最高达23.8%,错误工具调用减少4.6%
  • 适合需要可靠工具选择的复杂任务自动化系统

从过往成功轨迹中提取技能对大语言模型代理的高效演进至关重要。现有自进化范式普遍假设:基于成功轨迹构建的技能记忆能单调提升问题求解能力。然而探针分析发现,仅从成功轨迹提取技能会陷入‘技能模仿陷阱’——对于与过去相似但需不同工具的任务,检索更多技能反而使模型对错误工具调用的信心提升47%。为此,本文提出边界感知技能记忆(BASM),为每个技能添加显式的边界字段:适用条件、风险提示、规避规则和恢复笔记。这些字段将技能从无条件动作模板转变为状态条件引导:仅在条件满足时执行,不满足时抑制不当调用,并在失败时发起针对性修复。在三个代理基准和四种模型规模下,BASM持续优于仅从成功轨迹提炼的技能记忆基线:在AppWorld上任务成功率最高提升23.8%,在BFCL上准确率提升5.0%,在AgentDojo上攻击成功率降低4.6%,同时平均步骤数相比无记忆基线减少6.6%。

原文摘要 · Abstract (English)

Extracting skills from past successes is critical for the efficient evolution of Large Language Model (LLM) agents. Prevailing agent self-evolution paradigms typically rely on a core assumption: equipping LLMs with skill memories derived from successful trajectories will monotonically improve their problem-solving capabilities. However, probe analyses reveal that extracting skills solely from successful trajectories traps the model in a \textbf{Skill Imitation Trap}. For tasks that resemble past successes but require different tools, retrieving more skills paradoxically increases the model's confidence in wrong tool calls---procedure skills raise the wrong-tool margin by $47\%$ over a memory-free baseline. To overcome this limitation, we propose \textbf{Boundary-Aware Skill Memory} (BASM), which augments each skill with explicit boundary fields---applicability conditions, risk cues, avoidance rules, and recovery notes. These fields transform each retrieved skill from an unconditional action template into state-conditioned guidance: the agent applies the skill when its conditions hold, suppresses inapplicable tool calls when they do not, and issues targeted repairs when execution fails. Across three agent benchmarks and four model scales, BASM consistently outperforms success-distilled skill-memory baselines: it improves task success rate by up to $23.8\%$ on AppWorld, accuracy by up to $5.0\%$ on BFCL, and reduces attack success rate by $4.6\%$ on AgentDojo, while simultaneously reducing average AppWorld steps by up to $6.6\%$ relative to the memory-free baseline.

大模型代理技能记忆工具调用边界条件

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。