通过能力区域建模,提升技能检索准确率。
Skills Know Their Neighbors: Cluster-Contrastive Capability Pages for Skill Retrieval

- 构建能力页:正向触发、负向边界与判别主体三要素
- 在SRA-Bench上召回率平均提升2.94点,任务成功率升3.62点
- 无需修改在线模型,仅重构离线技能库即可生效
随着技能库增长,大语言模型代理需从语义相似但能力不同的候选技能中精准检索。现有方法受限于评分器和文本本身:文档可能描述技能功能,却未指明应排除的相似请求。本文将技能能力定义为可执行区域(executable region),即其能解决的查询集合,并视文档为该区域的有损观测。这一视角揭示了检索误差中无法仅靠优化检索器消除的文档固有成分。为此提出能力页(Capability Pages):包含正向触发$\ ext{Tpos}$、负向边界$\ ext{Tneg}$和判别主体$B$的聚类对比表示。离线编译器通过比邻技能生成这些字段。推理时,索引使用$\ ext{Tpos}$与$B$召回候选,路由器用$\ ext{Tneg}$排除混淆项。在含26,262个技能、5,400个问题的SRA-Bench上,所有五种检索器的Recall@10均提升,平均增益2.94点;加入$\ ext{Tneg}$后,四个执行器在六数据集上端到端任务成功率平均提高3.62点。跨条件中文SSL-SkillDiscovery迁移评估中,使用相同编码器达73.07% MRR@50。
原文摘要 · Abstract (English)
As skill libraries grow, large language model agents must retrieve reusable skills from candidates that often share the same topic and vocabulary but implement different capabilities. Retrieval is limited not only by the scorer but also by the text being scored: a document may describe what a skill does without stating which similar requests should be routed elsewhere. We formalize a skill's capability as its \emph{executable region}, the set of queries it can solve, and view its document as a lossy observation of that region. This view exposes a document-imposed component of retrieval error that cannot be removed by improving the retriever alone. We therefore propose \emph{Capability Pages}, cluster-contrastive skill representations containing a positive trigger $\Tpos$, a negative boundary $\Tneg$, and a discriminative body $B$. An offline compiler compares neighboring skills to write these fields. At inference time, the index uses $\Tpos$ and $B$ for candidate recall, while the router uses $\Tneg$ to reject confusable alternatives. On SRA-Bench, which contains 26{,}262 skills and 5{,}400 questions from six datasets, Capability Pages improve Recall@10 for all five tested retrievers, with a mean gain of $2.94$ points. Adding $\Tneg$ to candidate cards improves end-to-end task success by $3.62$ points on average across four executors and six datasets. A transfer evaluation on Chinese SSL-SkillDiscovery reaches $73.07\%$ MRR@50 using the same encoder across conditions. Capability Pages require no modification to the online models; they improve routing by rewriting the offline skill library.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。