arXiv:2604.06696cs.AI2026-04

让智能体系统高效路由,兼顾速度、隐私与成本

AgentGate: A Lightweight Structured Routing Engine for the Internet of Agents

  • 将路由任务拆解为动作决策和结构化执行两阶段
  • 3B-7B小模型在受限条件下实现媲美大模型的路由表现
  • 适合资源受限场景下的智能体系统设计与部署

AI智能体系统的快速发展催生了新兴的智能体互联网,各类专用智能体在本地设备、边缘节点、私有服务和云平台间协同工作。尽管已有研究改善了智能体命名、发现与交互,但高效请求调度仍面临延迟、隐私与成本的多重约束。本文提出AgentGate,一种面向候选智能体的轻量级结构化路由引擎。不同于自由文本生成式的路由方式,AgentGate将其建模为带约束的决策问题,分两阶段完成:第一阶段决定是否触发单智能体调用、多智能体规划、直接响应或安全升级;第二阶段将选定动作转化为可执行输出,如目标智能体、结构化参数或多步计划。为适配小型模型,我们设计了面向路由任务的微调方案,引入候选感知监督与硬负样本。在涵盖多个3B–7B开源模型的定制化路由基准上实验表明,紧凑模型在受限环境下可实现具有竞争力的路由性能,模型差异主要体现在动作预测、候选选择与结构化生成质量上。结果表明,结构化路由是高效且隐私友好的智能体系统可行的设计方向,尤其适用于资源受限部署场景。

原文摘要 · Abstract (English)

The rapid development of AI agent systems is leading to an emerging Internet of Agents, where specialized agents operate across local devices, edge nodes, private services, and cloud platforms. Although recent efforts have improved agent naming, discovery, and interaction, efficient request dispatch remains an open systems problem under latency, privacy, and cost constraints. In this paper, we present AgentGate, a lightweight structured routing engine for candidate-aware agent dispatch. Instead of treating routing as unrestricted text generation, AgentGate formulates it as a constrained decision problem and decomposes it into two stages: action decision and structural grounding. The first stage determines whether a query should trigger single-agent invocation, multi-agent planning, direct response, or safe escalation, while the second stage instantiates the selected action into executable outputs such as target agents, structured arguments, or multi-step plans. To adapt compact models to this setting, we further develop a routing-oriented fine-tuning scheme with candidate-aware supervision and hard negative examples. Experiments on a curated routing benchmark with several 3B--7B open-weight models show that compact models can provide competitive routing performance in constrained settings, and that model differences are mainly reflected in action prediction, candidate selection, and structured grounding quality. These results indicate that structured routing is a feasible design point for efficient and privacy-aware agent systems, especially when routing decisions must be made under resource-constrained deployment conditions.

智能体系统路由引擎轻量化结构化决策

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。