arXiv:2608.22695cs.CLcs.AI2026-08

用离线增强+在线检索排序,让智能体发现能力更准更快。

Enrich-Retrieve-Rank: Scaling Capability Discovery Beyond In-Context Routing

论文配图:Enrich-Retrieve-Rank: Scaling Capability Discovery Beyond In-Context Routing
图 1 · 摘自论文原文
  • 离线将零散元数据转为可搜索的完整档案,线上通过检索排序选出候选
  • 在7278个能力中,新方法准确率仍达39%,远超传统方法的12%
  • 适合大规模多智能体系统,部署成本降低70倍

当前智能体生态系统包含数千个MATs组件(模型、智能体、工具与技能),但发现能力仍依赖上下文路由。该方法将能力发现重构为对注册表的搜索:先离线增强,将稀疏元数据转化为可搜索的完整档案;再在线执行检索-排序流程,无需调用任何候选。实验显示,从10到7,278个能力时,上下文路由的匹配率(Match@1)从0.85骤降至0.12,而检索-排序方法仅从0.81降至0.39。在Nova Micro基准测试中,当组件数超过500时,新方法超越传统方案。相比全量上下文(Full-Ctx)和搜索后选择(Search&Pick)两种基线,该管道在全规模下提升6.5个百分点(Match@1),成本仅为一半。固定配置适用于各类注册表,已在大规模多智能体平台中上线为默认发现层。

原文摘要 · Abstract (English)

Agent ecosystems now include thousands of MATS components (Models, Agents, Tools, and Skills), yet their discovery still relies on in-context routing. These systems read a registry (names, hints, or descriptions, as context budget permits), pick a candidate, invoke it, and retry on failure. This pattern degrades with scale, and registries are growing fast. We recast capability discovery as search over a registry by defining an offline enrichment step that turns sparse metadata into searchable profiles, and an online retrieve-then-rank pipeline that returns a ranked shortlist without invoking any candidates online. We show that from N=10 to 7,278 capabilities, in-context routing's top-1 accuracy (Match@1) collapses (0.85 to 0.12), while retrieve-then-rank degrades more gently (0.81 to 0.39) because its reranker still ranks the right capability first 0.70-0.87 of the time once retrieval finds it. In the Nova Micro sweep, the crossover is around N=500. We compare against two in-context baselines. Full-Ctx puts the whole registry in the prompt and asks the LLM to pick. Search&Pick gives the LLM a search tool to narrow candidates before it picks. At full scale the pipeline leads Search&Pick by 6.5 percentage points (pp) on Match@1 at about half the cost. It reduces cost 70x versus Full-Ctx. We use a fixed configuration (same enrichment, retriever, and scorer weights) across agent, tool, and skill registries. The pipeline runs in production as the default capability-discovery layer of a large-scale multi-agent platform.

智能体系统能力发现检索排序多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。