arXiv:2607.18098cs.CL2026-07中稿 · EMNLP

通过分析查询难度,智能选择最适合的大模型,降本增效。

VDAR-Router: Adaptive LLMs Routing via Verbalized Query Difficulty Analysis Retrieval

论文配图:VDAR-Router: Adaptive LLMs Routing via Verbalized Query Difficulty Analysis Retrieval
图 1 · 摘自论文原文
  • 先分析查询难度,再检索相似历史案例
  • 在三个数据集上均优于现有方法的性价比表现
  • 无需训练,适合部署在资源受限的场景

大语言模型在实际系统中应用日益广泛,高效模型选择对降低部署成本至关重要。现有路由方法通常基于输入查询的表层语义或嵌入相似性判断模型适配度,但可能忽略查询的内在难度,导致次优决策。为此,我们提出VDAR-Router——一种基于难度感知的检索式路由框架。针对每个输入查询,该框架首先生成显式的难度分析,随后检索具有相似难度特征的历史样本。基于检索到的记录,估计候选模型适配度,并利用兼顾性能与成本的奖励函数进行模型选择。在三个数据集上的实验表明,VDAR-Router始终优于现有基线,在成本-性能权衡上表现更优。案例研究进一步验证,显式查询分析有助于检索更相关的历史实例,提升路由决策可靠性。结果证明,难度感知检索在无需训练的大模型路由中具有显著有效性。

原文摘要 · Abstract (English)

Large language models are increasingly used in practical systems, making efficient model selection important for reducing deployment cost. LLM routing has emerged as a practical solution for allocating each input query to an appropriate model under a desired cost-performance trade-off. Existing routing methods often estimate model suitability from the surface semantics or embedding similarity of the input query. However, such methods may ignore the underlying difficulty of a query, leading to suboptimal routing decisions. To address the challenge, we propose VDAR-Router, a difficulty-aware retrieval-based routing framework. For each input query, VDAR-Router first generates an explicit difficulty analysis. It then retrieves historical examples with similar difficulty profiles. Based on the retrieved records, it estimates candidate model suitability and selects the model using a reward function that considers both performance and cost. Experiments on three datasets show that VDAR-Router consistently achieves better cost-performance trade-offs than existing baselines. These results demonstrate the effectiveness of difficulty-aware retrieval for training-free LLM routing. Case studies further show that explicit query analysis helps retrieve more relevant examples and supports more reliable routing decisions.

大模型路由难度分析检索增强低成本部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。