让大模型路由更懂用户偏好,自动匹配最适合的模型。
Arch-Router: Aligning LLM Routing with Human Preferences
- 用用户定义的领域或动作类型来指导模型选择
- 在对话数据集上超越主流商用模型,实现SOTA表现
- 无需重训即可新增模型,适合实际部署场景
随着大语言模型数量激增,每种模型在性能、风格或延迟/成本上各有优劣,模型路由成为关键。但现有方法存在两大局限:评估依赖基准测试,难以反映主观的人类偏好;且仅限于少量模型池。本文提出一种对齐人类偏好的路由框架,通过将查询匹配到用户定义的领域(如旅行)或动作类型(如图像编辑),实现可解释且灵活的路由决策。我们设计了轻量级1.5B参数的Arch-Router模型,学习将查询映射至领域-动作偏好以指导路由。该方法支持无缝接入新模型,无需重新训练或修改架构。在多个对话数据集上的实验表明,该方法在匹配人类偏好方面达到当前最优(SOTA),优于顶尖商业模型。模型已开源:https://huggingface.co/katanemo/Arch-Router-1.5B。
原文摘要 · Abstract (English)
With the rapid proliferation of large language models (LLMs) -- each optimized for different strengths, style, or latency/cost profile -- routing has become an essential technique to operationalize the use of different models. However, existing LLM routing approaches are limited in two key ways: they evaluate performance using benchmarks that often fail to capture human preferences driven by subjective evaluation criteria, and they typically select from a limited pool of models. In this work, we propose a preference-aligned routing framework that guides model selection by matching queries to user-defined domains (e.g., travel) or action types (e.g., image editing) -- offering a practical mechanism to encode preferences in routing decisions. Specifically, we introduce \textbf{Arch-Router}, a compact 1.5B model that learns to map queries to domain-action preferences for model routing decisions. Our approach also supports seamlessly adding new models for routing without requiring retraining or architectural modifications. Experiments on conversational datasets demonstrate that our approach achieves state-of-the-art (SOTA) results in matching queries with human preferences, outperforming top proprietary models. Our approach captures subjective evaluation criteria and makes routing decisions more transparent and flexible. Our model is available at: \texttt{https://huggingface.co/katanemo/Arch-Router-1.5B}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。