arXiv:2604.24594cs.CLcs.AI2026-04被引 40

让智能体动态检索外部技能,突破原有能力限制。

Skill Retrieval Augmentation for Agentic AI

论文配图:Skill Retrieval Augmentation for Agentic AI
图 1 · 摘自论文原文
  • 提出动态检索外部技能的新方法,避免硬编码技能列表。
  • 在2.6万技能库中测试,显著提升任务完成率。
  • 揭示当前模型无法判断何时需要外部技能的瓶颈。

随着大语言模型演变为自主问题求解者,它们越来越依赖外部可复用的技能来处理自身参数能力之外的任务。现有智能体系统主要通过显式列出可用技能来集成技能,但该方法难以扩展:随着技能库增大,上下文窗口迅速被占满,智能体识别正确技能的准确率显著下降。为此,本文提出技能检索增强(SRA)新范式,使智能体能够按需从大型外部技能库中动态检索、融合并应用相关技能。为使该问题可衡量,我们构建了大规模技能库,并引入SRA-Bench——首个针对完整SRA流程的分解评估基准,涵盖技能检索、技能融合与最终任务执行。SRA-Bench包含5,400个高能力需求的测试实例和636个手工构造的黄金技能,与网络收集的干扰技能混合,构成总计26,262个技能的大型语料库。大量实验表明,基于检索的技能增强能显著提升智能体性能,验证了该范式的潜力。同时,我们发现技能融合存在根本性差距:当前大模型倾向于以相似速率加载技能,无论是否检索到黄金技能或任务是否真正需要外部能力。这表明技能增强的瓶颈不仅在于检索,更在于基础模型判断应加载哪个技能以及何时需要外部调用的能力。这些发现将SRA定位为一个独立的研究问题,并为未来智能体系统的可扩展能力增强奠定基础。

原文摘要 · Abstract (English)

As large language models (LLMs) evolve into agentic problem solvers, they increasingly rely on external, reusable skills to handle tasks beyond their native parametric capabilities. In existing agent systems, the dominant strategy for incorporating skills is to explicitly enumerate available skills within the context window. However, this strategy fails to scale: as skill corpora expand, context budgets are consumed rapidly, and the agent becomes markedly less accurate in identifying the right skill. To this end, this paper formulates Skill Retrieval Augmentation (SRA), a new paradigm in which agents dynamically retrieve, incorporate, and apply relevant skills from large external skill corpora on demand. To make this problem measurable, we construct a large-scale skill corpus and introduce SRA-Bench, the first benchmark for decomposed evaluation of the full SRA pipeline, covering skill retrieval, skill incorporation, and end-task execution. SRA-Bench contains 5,400 capability-intensive test instances and 636 manually constructed gold skills, which are mixed with web-collected distractor skills to form a large-scale corpus of 26,262 skills. Extensive experiments show that retrieval-based skill augmentation can substantially improve agent performance, validating the promise of the paradigm. At the same time, we uncover a fundamental gap in skill incorporation: current LLM agents tend to load skills at similar rates, regardless of whether a gold skill is retrieved or whether the task actually requires external capabilities. This shows that the bottleneck in skill augmentation lies not only in retrieval but also in the base model's ability to determine which skill to load and when external loading is actually needed. These findings position SRA as a distinct research problem and establish a foundation for the scalable augmentation of capabilities in future agent systems.

智能体技能检索LLM能力增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。