arXiv:2509.25426cs.AIcs.LG2025-09被引 4

根据题目难易和模型能力自动分配推理资源,提升效率与效果。

RADAR: Reasoning-Ability and Difficulty-Aware Routing for Reasoning LLMs

  • 基于心理测量学构建可解释的路由机制,动态匹配任务难度与模型能力。
  • 在8个基准上优于现有方法,且对未见过的任务也表现稳定。
  • 轻量可扩展,支持新增模型快速评估并自动选型。

推理语言模型在数学、科学和编程等挑战性任务中表现出色。实际部署时需权衡模型规模与推理预算之间的性能与成本关系:模型越大、预算越高,性能越好,但代价也更高。本文从模型配置路由角度出发,提出RADAR(Reasoning-Ability and Difficulty-Aware Routing)——一种轻量、可解释且可扩展的路由框架。受心理测量学启发,RADAR从不同预算下模型对各类查询的响应中学习项目反应模型,获得可解释参数:查询难度与模型-预算能力。系统据此将高难度任务分配给高能力模型-预算组合,低难度则反之。我们在8个广泛使用的推理基准上进行大量实验,结果表明RADAR显著优于现有最优路由方法。此外,其具备良好的查询泛化能力,在所有基准上的分布外查询中均表现优异。该框架还可高效扩展,仅需动态选取少量评估查询即可估计新模型的能力并完成集成。

原文摘要 · Abstract (English)

Reasoning language models have demonstrated remarkable performance on many challenging tasks in math, science, and coding. Choosing the right reasoning model for practical deployment involves a performance and cost tradeoff at two key levels: model size and reasoning budget, where larger models and higher reasoning budget lead to better performance but with increased cost and latency. In this work, we tackle this tradeoff from the angle of model configuration routing for different queries, and present RADAR (Reasoning-Ability and Difficulty-Aware Routing), a lightweight, interpretable, and scalable routing framework. Inspired by psychometrics, RADAR learns an item response model from model responses with different budgets to different queries, with interpretable parameters including query difficulties and model-budget abilities. RADAR then routes queries with higher difficulty to model-budget pairs with higher ability, and vice versa. We conduct extensive experiments on 8 widely used challenging reasoning benchmarks, demonstrating the superior performance of RADAR compared to state-of-the-art model routing methods. RADAR also exhibits query generalization capabilities, showing strong performance on out-of-distribution queries in all benchmarks. RADAR is also scalable and can efficiently integrate additional models by dynamically selecting a small set of evaluation queries to estimate their abilities.

推理模型路由机制可解释性模型调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。