用轻量分类器根据查询类型自动选检索策略,节省28% token开销。
Lightweight Query Routing for Adaptive RAG: A Baseline Study on RAGRouter-Bench
- 基于关键词和句向量设计五种分类器,评估其路由效果。
- 最优方案准确率93.2%,比全用高价策略省28.1%计算量。
- 医学类查询最难分类,法律类最易,适合高效RAG系统参考。
检索增强生成(RAG)流程采用多种检索策略,其在令牌开销和能力上差异显著。针对每个查询选择合适策略是实际中的效率难题。现有路由分类器尚未在RAGRouter-Bench这一新基准上训练,该基准包含7,727个跨四个知识领域的问题,每题标注为事实型、推理型或摘要型三类之一。本文首次系统评估轻量级分类器在该基准上的表现。五种经典分类器在三种特征组合下测试:TF-IDF、MiniLM句向量(Reimers & Gurevych, 2019)及手工构造的结构特征,共15种组合。最佳配置(TF-IDF + SVM)实现宏平均F1为0.928,准确率达93.2%,相比始终使用最昂贵策略,模拟节省28.1%的令牌消耗。词法特征优于语义嵌入,高3.1点宏平均F1,表明表面关键词模式是预测查询复杂性的强指标。领域分析显示,医疗类查询最难路由,法律类最易。本研究建立可复现的查询端基线,并揭示了需由语料感知路由解决的差距。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation pipelines span a wide range of retrieval strategies that differ substantially in token cost and capability. Selecting the right strategy per query is a practical efficiency problem, yet no routing classifiers have been trained on RAGRouter-Bench \citep{wang2026ragrouterbench}, a recently released benchmark of $7,727$ queries spanning four knowledge domains, each annotated with one of three canonical query types: factual, reasoning, and summarization. We present the first systematic evaluation of lightweight classifier-based routing on this benchmark. Five classical classifiers are evaluated under three feature regimes, namely, TF-IDF, MiniLM sentence embeddings \citep{reimers2019sbert}, and hand-crafted structural features, yielding 15 classifier feature combinations. Our best configuration, TF-IDF with an SVM, achieves a macro-averaged F1 of $\mathbf{0.928}$ and an accuracy of $\mathbf{93.2\%}$, while simulating $\mathbf{28.1\%}$ token savings relative to always using the most expensive paradigm. Lexical TF-IDF features outperform semantic sentence embeddings by $3.1$ macro-F1 points, suggesting that surface keyword patterns are strong predictors of query-type complexity. Domain-level analysis reveals that medical queries are hardest to route and legal queries most tractable. These results establish a reproducible query-side baseline and highlight the gap that corpus-aware routing must close.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。