arXiv:2511.11233cs.AI2025-11被引 2

让大模型慢思考,提升表格推理的准确性和稳定性

STaR: Towards Effective and Stable Table Reasoning via Slow-Thinking Large Language Models

  • 分两阶段训练:先微调再强化学习,增强多步推理能力
  • 在多个表格数据集上超越现有方法,跨域泛化能力强
  • 通过轨迹级不确定性量化,选出更可靠的推理路径

大语言模型在表格推理中扮演关键角色,但现有方法推理深度不足且结果不稳定,主要源于模型不确定性。本文提出STaR,一种新型慢思考模型,实现高效且稳定的表格推理。通过两阶段训练框架:首先利用自动自验证构建高质量数据集进行监督微调(SFT),再引入难度感知强化学习机制进行强化微调(RFT),提升推理能力。为提高稳定性,提出轨迹级不确定性量化方法,融合词级置信度与答案级一致性,筛选更优推理路径。大量实验表明,STaR-8B在领域内基准上达到顶尖性能,并展现出对域外数据的强大泛化能力,显著提升表格推理的有效性与稳定性。

原文摘要 · Abstract (English)

Table reasoning with large language models (LLMs) plays a critical role in building intelligent systems capable of understanding and analyzing tabular data. Despite recent progress, existing methods still face key limitations: their reasoning processes lacks depth and explicit multi-step reasoning, often relying solely on implicit language model understanding. In addition, their reasoning processes suffer from instability, primarily caused by model uncertainty. In this work, we propose STaR, a novel slow-thinking model that can achieve effective and stable table reasoning. To enable effective multi-step reasoning, we design a two-stage training framework consisting of supervised fine-tuning (SFT) warm-up followed by reinforced fine-tuning (RFT). Specifically, in the SFT stage, we construct a high-quality dataset through automatic self-verification. In the RFT stage, we introduce a difficulty-aware reinforcement learning mechanism to further enhance reasoning capabilities. Furthermore, to improve reasoning stability, we introduce trajectory-level uncertainty quantification, which fuses token-level confidence with answer-level consistency, enabling the selection of better reasoning trajectories. Extensive experiments demonstrate that STaR-8B achieves state-of-the-art performance on in-domain benchmarks and exhibits strong generalization to out-of-domain datasets, highlighting its potential for enhancing both effectiveness and stability in table reasoning.

表格推理大模型强化学习稳定性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。