arXiv:2512.09386cs.CLcs.AI2025-12被引 1

提出可持续更新的路由框架,自动匹配任务与最优计算策略。

CONCUR: A Framework for Continual Constrained and Unconstrained Routing

  • 为每种策略独立训练预测模型,支持新策略快速接入。
  • 在多类任务上实现更高准确率和更低推理成本。
  • 适合需要动态调整计算资源的AI系统部署场景。

AI任务复杂度各异,需采用不同计算策略(如模型组合与解码方法)。现有方法通常用单一模型覆盖所有策略,新增策略时需全量重训,且难以泛化。此外,多数模型仅使用单一输入表示,无法充分捕捉路由问题的复杂性。为此,我们提出CONCUR框架,支持有预算与无预算的持续路由。其模块化设计为每种策略训练独立预测器,可低开销引入新策略;同时利用任务与策略的多重表征,更全面建模问题复杂度。在分布内与分布外、知识密集型与推理密集型任务上的实验表明,该方法在端到端准确率和推理成本上均优于最佳单策略及现有强基线,在持续与非持续设置下表现一致优异,并显著降低持续学习阶段的训练开销。

原文摘要 · Abstract (English)

AI tasks differ in complexity and are best addressed with different computation strategies (e.g., combinations of models and decoding methods). Hence, an effective routing system that maps tasks to the appropriate strategies is crucial. Most prior methods build the routing framework by training a single model across all strategies, which demands full retraining whenever new strategies appear and leads to high overhead. Attempts at such continual routing, however, often face difficulties with generalization. Prior models also typically use a single input representation, limiting their ability to capture the full complexity of the routing problem and leading to sub-optimal routing decisions. To address these gaps, we propose CONCUR, a continual routing framework that supports both constrained and unconstrained routing (i.e., routing with or without a budget). Our modular design trains a separate predictor model for each strategy, enabling seamless incorporation of new strategies with low additional training cost. Our predictors also leverage multiple representations of both tasks and computation strategies to better capture overall problem complexity. Experiments on both in-distribution and out-of-distribution, knowledge- and reasoning-intensive tasks show that our method outperforms the best single strategy and strong existing routing techniques with higher end-to-end accuracy and lower inference cost in both continual and non-continual settings, while also reducing training cost in the continual setting.

持续学习任务路由计算优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。