用小模型+伪文档+精细匹配,实现400毫秒内精准发现AI代理。
GRAIL: A Deep-Granularity Hybrid Resonance Framework for Real-Time Agent Discovery via SLM-Enhanced Indexing

- 用微调小语言模型替代大模型,快速生成代理能力标签。
- 通过合成查询扩充代理描述,提升语义密度以支持高效检索。
- 基于最大相似度的细粒度匹配,避免语义模糊,适合工业级实时系统。
随着基于大语言模型的智能体生态迅速扩展,高效准确的代理发现成为大规模多智能体协作的关键瓶颈。现有方法通常面临两难:依赖重型大模型进行意图解析,导致延迟高达30秒以上;或采用单体向量检索,牺牲语义精度换取速度。为此,我们提出GRAIL(Granular Resonance-based Agent/AI Link)框架,实现低于400毫秒的发现延迟且不损失准确性。GRAIL引入三项创新:(1) SLM-Enhanced Prediction,用专门微调的小语言模型(SLM)实现毫秒级能力标签预测;(2) Pseudo-Document Expansion,通过合成查询扩充代理描述,增强语义密度以支持鲁棒密集检索;(3) MaxSim Resonance,一种细粒度匹配机制,计算用户查询与离散代理使用示例间的最大相似度,有效缓解语义稀释。在新构建的9,240个智能体的大规模数据集AgentTaxo-9K上验证,GRAIL相较基于LLM的基线将端到端发现延迟降低超过79倍,同时在Recall@10上显著优于传统向量搜索。该框架为实时‘智能体互联网’提供可扩展的工业级解决方案。
原文摘要 · Abstract (English)
As the ecosystem of Large Language Model (LLM)-based agents expands rapidly, efficient and accurate Agent Discovery becomes a critical bottleneck for large-scale multi-agent collaboration. Existing approaches typically face a dichotomy: either relying on heavy-weight LLMs for intent parsing, leading to prohibitive latency (often exceeding 30 seconds), or using monolithic vector retrieval that sacrifices semantic precision for speed. To bridge this gap, we propose \textbf{GRAIL} (Granular Resonance-based Agent/AI Link), a novel framework achieving sub-400ms discovery latency without compromising accuracy. GRAIL introduces three key innovations: (1) \textbf{SLM-Enhanced Prediction}, replacing the generalized LLM parser with a specialized, fine-tuned Small Language Model (SLM) for millisecond-level capability tag prediction; (2) \textbf{Pseudo-Document Expansion}, augmenting agent descriptions with synthetic queries to enhance semantic density for robust dense retrieval; and (3) \textbf{MaxSim Resonance}, a fine-grained matching mechanism computing maximum similarity between user queries and discrete agent usage examples, effectively mitigating semantic dilution. Validated on \textbf{AgentTaxo-9K}, our new large-scale dataset of 9,240 agents, GRAIL reduces end-to-end discovery latency by over \textbf{79$\times$} compared to LLM-parsing baselines, while significantly outperforming traditional vector search in Recall@10. This framework offers a scalable, industrial-grade solution for the real-time ``Internet of Agents."
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。