arXiv:2602.11700cs.LGcs.AI2026-02被引 5

让表格模型主动选关键行作证据,提升预测准确率。

TabSieve: Explicit In-Table Evidence Selection for Tabular Prediction

  • 先选相关行作证据,再基于证据预测目标值。
  • 分类任务平均提升2.92%,回归任务平均提升4.45%。
  • 适合需要可解释推理的表格预测场景。

表格预测可受益于表内行作为少样本证据,但现有模型通常进行逐实例推理,基于大模型的提示方法往往不稳定,无法一致利用相关行,噪声上下文会降低性能。为此,我们提出TabSieve,一种先选择后预测的框架,使证据使用过程显式且可审计。给定一张表和查询行,TabSieve首先选出少量信息量高的行作为证据,再基于所选证据预测缺失目标。为实现该能力,我们通过强教师模型在331张真实表上合成高质量推理轨迹,构建了TabSieve-SFT-40K数据集,并引入TAB-GRPO强化学习算法,分别优化证据选择与预测正确性,通过动态任务优势平衡稳定混合回归与分类训练。在包含75个分类和52个回归任务的保留基准测试中,TabSieve在不同样本预算下均表现更优,分类任务平均提升2.92%,回归任务平均提升4.45%,优于次优基线。进一步分析表明,TabSieve更聚焦于所选证据,提升了对噪声上下文的鲁棒性。

原文摘要 · Abstract (English)

Tabular prediction can benefit from in-table rows as few-shot evidence, yet existing tabular models typically perform instance-wise inference and LLM-based prompting is often brittle. Models do not consistently leverage relevant rows, and noisy context can degrade performance. To address this challenge, we propose TabSieve, a select-then-predict framework that makes evidence usage explicit and auditable. Given a table and a query row, TabSieve first selects a small set of informative rows as evidence and then predicts the missing target conditioned on the selected evidence. To enable this capability, we construct TabSieve-SFT-40K by synthesizing high-quality reasoning trajectories from 331 real tables using a strong teacher model with strict filtering. Furthermore, we introduce TAB-GRPO, a reinforcement learning recipe that jointly optimizes evidence selection and prediction correctness with separate rewards, and stabilizes mixed regression and classification training via dynamic task-advantage balancing. Experiments on a held-out benchmark of 75 classification and 52 regression tables show that TabSieve consistently improves performance across shot budgets, with average gains of 2.92% on classification and 4.45% on regression over the second-best baseline. Further analysis indicates that TabSieve concentrates more attention on the selected evidence, which improves robustness to noisy context.

表格预测证据选择强化学习少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。