用大模型实现智能代理的语义匹配,解决跨场景内容订阅难题
Neural Router: Semantic Content Matching for Agentic AI

- 基于大模型构建语义匹配引擎,支持边缘到云端的智能代理内容订阅
- 发现模型性能存在两个关键拐点:压缩无法挽回精度损失,仅前沿模型能处理大规模订阅
- 后端模型选择比参数调优更重要,适合系统设计者和平台开发者参考
大型语言模型(LLMs)可作为跨边缘-云计算环境的智能代理内容订阅系统中的语义匹配引擎,弥合词汇与模态差异,克服关键词和嵌入式过滤器的局限。在涵盖社交媒体、法律和智能家居传感器领域的三个公开数据集上,对六种大模型与七种基线方法进行离线多标签检索评估。核心贡献为两个交叉点的代价-精度刻画:一是上下文窗口低于某一阈值时,CoverAndMerge压缩流水线能减少大模型调用;二是当模型分辨能力超过某临界值后,匹配精度会独立于上下文预算崩溃,且该崩溃程度由模型参数量和训练世代决定。实践发现:超过分辨拐点后,压缩无法恢复精度,仅前沿规模模型可覆盖大范围订阅集;后端模型选择显著优于配置调优,因此模型选型是主要操作杠杆。论文还提供了三种可组合算法及面向集群的体验质量框架,支持自主的大模型层级选择。
原文摘要 · Abstract (English)
Large language models (LLMs) can serve as the semantic-matching engine of a content-based publish/subscribe broker for agentic AI across the edge-cloud computing continuum, bridging the vocabulary and modality gaps that defeat keyword and embedding filters. Framed as offline multi-label retrieval over three public datasets spanning social-media, legal, and smart-home sensor domains (six LLMs, seven baselines), our central contribution is a two-crossover cost-accuracy characterisation: an analytical context-window crossover below which a CoverAndMerge compression pipeline reduces LLM invocations, and an empirical discrimination-capacity crossover above which matching accuracy collapses independently of context budget, by a model-dependent factor of parameter count and training generation. Two findings carry practical weight: above the discrimination crossover, compression cannot recover accuracy and only frontier-scale models clear large subscription sets; and there backend choice dominates configuration choice, so model selection, not pipeline tuning, is the primary operator lever. We accompany this with three composable algorithms and a per-cluster Quality-of-Experience framework for autonomic LLM-tier selection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。