arXiv:2601.22530cs.AI2026-01被引 2

用确定性奖励提升大模型表格推理能力,无需训练即可显著提效

Enhancing Table Reasoning with Deterministic Table-State Rewards

  • 基于最长公共子序列设计可解释的中间状态奖励机制
  • 在六个模型三类数据集上平均准确率提升26.7个百分点
  • 适合需要高可靠、零训练成本表格推理的应用场景

大语言模型在结构化表格的多步推理中表现不佳,主要因缺乏对中间推理状态的有效监督。现有学习型奖励模型或执行器验证器或难以扩展,或依赖无法通用的答对检查环境。为此,本文提出TABROUGE——一种无需训练、确定性的状态奖励机制。通过将文本摘要中的最长公共子序列(LCS)度量适配到表格状态评估,TABROUGE在不依赖学习模型或外部执行器的前提下,衡量中间表格与查询间的词汇覆盖率与结构完整性。基于此,我们构建RE-TAB框架:一个即插即用、无需训练的推理系统,将表格推理重构为对中间状态的确定性控制,利用TABROUGE提供逐步反馈与轨迹级测试时扩展(TTS)信号。在六种骨干模型与三个基准测试上,RE-TAB相较无奖励基线平均提升26.7个百分点准确率,并将TTS样本减少最多33%。初步GRPO实验表明,TABROUGE作为可扩展的后训练奖励具备可行性,进一步带来8.34个百分点的增益。我们还分析了其失效模式,包括同义句奖励不足与列回声攻击问题,明确了结构感知词法奖励的适用边界。

原文摘要 · Abstract (English)

Large Language Models (LLMs) struggle with multi-step reasoning over structured tables. The primary reason is the lack of explicit supervision for intermediate reasoning states. Existing learned reward models or executor-based verifiers are either unscalable or rely on answer-checking environments unavailable for many tabular tasks. This leaves no signal that is scalable and grounded in the query. To address this, we introduce TABROUGE, a training-free and deterministic state reward. By adapting the Longest Common Subsequence (LCS) metric from text summarization to evaluate tabular states, TABROUGE assesses the lexical coverage and structural integrity of intermediate tables against the query without requiring learned models or external executors. Built upon this metric, we propose RE-TAB, a plug-and-play, training-free framework. RE-TAB reframes table reasoning as deterministic control over intermediate states, utilizing TABROUGE for stepwise feedback and trajectory-level test-time scaling (TTS) signals. Across six backbones and three benchmarks, RE-TAB improves accuracy by an average of 26.7 pp over no-reward baselines. It also reduces TTS samples by up to 33%. Preliminary GRPO experiments further indicate TABROUGE's viability as a scalable post-training reward, increasing gains by 8.34 pp. We further analyze failure modes of TABROUGE, including paraphrase under-rewarding and echo-column hacking, and identify when structure-aware lexical rewards remain reliable.

表格推理奖励机制零训练大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。