arXiv:2605.29319cs.CL2026-05

通过区分表格与文本不确定性,实现更高效的表格推理路由。

Rethinking Stepwise Model Routing: A Cost-Efficient Table Reasoning Perspective

论文配图:Rethinking Stepwise Model Routing: A Cost-Efficient Table Reasoning Perspective
图 1 · 摘自论文原文
  • 分别估计表格和文本的不确定性,指导模型选择
  • 在多个基准上提升准确率与效率平衡,最高节省40%计算成本
  • 适合需要高效推理的表格问答系统开发者

大型推理模型在表格推理任务中表现强劲,但因推理轨迹过长导致高昂的推理开销。分步模型路由通过动态将推理步骤分配给小型或大型模型来缓解此问题。然而,针对表格推理的分步路由仍研究不足。我们通过实证分析发现,涉及表格的推理步骤包含两类具有不同不确定性的标记:基于表格结构的标记(如单元格值、表头)和表示周围自然语言推理的文本标记。这两类标记的不确定性均与模型在下一步出错的风险相关。现有方法未能分别建模,导致路由决策不优。为此,我们提出EcoTab,一种面向表格推理的感知型分步路由框架。在每一步推理中,EcoTab分别估计表格标记与文本标记的不确定性,将其映射为小模型下一步失败风险,并综合两者的风险进行路由。在多个表格推理基准上的实验表明,EcoTab持续优于强基线,且在准确率与效率间取得更好平衡。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) achieve strong performance on table reasoning tasks but incur substantial inference cost due to long reasoning traces. Stepwise model routing mitigates this issue by dynamically assigning reasoning steps to smaller or larger models. However, stepwise model routing for table reasoning remains underexplored. Through empirical analysis, we find that reasoning steps involving tables contain two types of tokens with distinct uncertainty distributions: table tokens grounded in table structure, such as cell values and headers, and text tokens representing surrounding natural-language reasoning. The uncertainty of both token types is correlated with the risk that the model makes an error in the next reasoning step. However, existing methods fail to model them separately, leading to suboptimal routing decisions. To address this, we propose EcoTab, a table-aware stepwise routing framework for efficient table reasoning. At each reasoning step, EcoTab separately estimates the uncertainties of table tokens and text tokens, maps them to next-step failure risks for the small model, and combines the two risks for routing. Experiments on multiple table reasoning benchmarks show that EcoTab consistently outperforms strong baselines and achieves a better balance between accuracy and efficiency.

表格推理模型路由效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。