arXiv:2608.23023cs.CL2026-08

多数大模型路由误差源于任务类型差异,静态分配更优。

Most of the LLM Routing Gap Is Task Type

  • 按任务类型预先分配模型,无需动态学习
  • 21/29 可优化问题由任务类型决定,显著优于随机路由
  • 静态策略在成本与准确率上全面超越单模型最优

LLM 路由器旨在为每条查询选择最适模型。尽管理想中不同模型在不同任务上表现各异,但现有方法在5个基准上21种设计均表现相近且远低于理论上限。我们测试了14个模型在3种语言(韩、英、印)下294个问题的表现,发现重复运行间有5.37%的评分差异,说明随机波动本身已影响结果。严格要求两次运行均正确才计为正确答案后,仅29个问题可被路由改进。其中21个由任务类型决定,按类型预分配模型即可解决;再按语言细分可再提升2个,剩余6个才是真正需要学习路由的。该静态表在262/294问题上达到$3.33/次成本,优于最强单模型的$7.69,所有结果均基于相同294问题训练与评估,无预留数据集。

原文摘要 · Abstract (English)

An LLM router picks which model should answer each query. The appeal is that models fail on different questions. Whatever single model is best overall still gets some wrong, and another model in the pool gets many of those right. Getting that choice right every time is the ceiling, and a router is an attempt to approach it. However, recent work reports that routers do not get close. Across 21 routing methods on five benchmarks, sharply different designs land within a fraction of a point of each other, and all of them stay far below that ceiling. Learned routers often fail to beat simply always calling the strongest model. We ask what those missed questions have in common. We set fourteen models to answer all 294 questions, with 7 task types across 3 languages: Korean, English and Hindi. We ran the whole matrix twice, changing nothing, but 5.37% of the 4,116 model-question pairs came out scored differently anyway. Run-to-run movement like that is normal, and we argue that a small win does not show that routing did anything, ours or anyone else's. Counting an answer correct only when the model got it right in both runs, 29 questions on this matrix can be improved with routing. Every correct-answer count here is on that rule. Task type accounts for most of them: assigning each task type one model in advance, chosen once and never updated, improves 21 of the 29. Splitting each task type by language improves 2 more and leaves 6 of 294 unoptimized. That handful is what a learned router would have been built for, and it is smaller than the run-to-run movement above, which is a share of pairs rather than of questions. The static table we adopted answers 262 of 294 questions at \$3.33 per run, against the best single model's 245 at \$7.69. All of this is fitted and scored on the same 294 questions with no holdout.

大模型路由任务类型静态分配成本优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。