用蚂蚁算法优化大模型多智能体路由,省钱省时还看得懂。
Efficient and Interpretable Multi-Agent LLM Routing via Ant Colony Optimization
- 用小模型分析意图,蚂蚁算法动态选路径,降低推理开销。
- 在五个基准测试中,比基线方案提升质量-成本平衡,高并发下仍稳定。
- 路由过程留痕可追溯,适合需要透明决策的场景如医疗、金融。
大型语言模型驱动的多智能体系统在复杂推理和工具使用方面表现出色,异构智能体池进一步拓展了质量与成本的权衡空间。然而,实际部署常受限于高昂的推理成本、延迟以及透明度不足,阻碍了系统的可扩展性和效率。现有路由策略通常依赖昂贵的基于LLM的选择器或静态策略,在动态负载和混合意图下缺乏语义感知的可控性,导致性能不稳定和资源利用低效。为此,我们提出AMRO-S,一种高效且可解释的多智能体系统路由框架。AMRO-S将路由建模为语义条件下的路径选择问题,通过三个关键机制提升性能:首先,采用监督微调的小型语言模型进行意图推断,为每个查询提供低开销的语义接口;其次,将路由记忆分解为任务特异的信息素专家,减少跨任务干扰,优化混合负载下的路径选择;最后,采用质量门控的异步更新机制,将推理与学习解耦,实现无延迟优化。在五个公开基准和高并发压力测试中,AMRO-S持续优于强基线,在质量-成本权衡上表现更优,并通过结构化的信息素模式提供可追踪的路由证据。
原文摘要 · Abstract (English)
Large Language Model (LLM)-driven Multi-Agent Systems (MAS) have demonstrated strong capability in complex reasoning and tool use, and heterogeneous agent pools further broaden the quality--cost trade-off space. Despite these advances, real-world deployment is often constrained by high inference cost, latency, and limited transparency, which hinders scalable and efficient routing. Existing routing strategies typically rely on expensive LLM-based selectors or static policies, and offer limited controllability for semantic-aware routing under dynamic loads and mixed intents, often resulting in unstable performance and inefficient resource utilization. To address these limitations, we propose AMRO-S, an efficient and interpretable routing framework for Multi-Agent Systems (MAS). AMRO-S models MAS routing as a semantic-conditioned path selection problem, enhancing routing performance through three key mechanisms: First, it leverages a supervised fine-tuned (SFT) small language model for intent inference, providing a low-overhead semantic interface for each query; second, it decomposes routing memory into task-specific pheromone specialists, reducing cross-task interference and optimizing path selection under mixed workloads; finally, it employs a quality-gated asynchronous update mechanism to decouple inference from learning, optimizing routing without increasing latency. Extensive experiments on five public benchmarks and high-concurrency stress tests demonstrate that AMRO-S consistently improves the quality--cost trade-off over strong routing baselines, while providing traceable routing evidence through structured pheromone patterns.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。