让AI像专业分析师一样,分步规划再执行表格推理。
PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tables
- 分阶段规划+代码执行,系统化推进表格推理
- 在四个数据集上准确率显著提升,结果可解释且可复现
- 适合需要高可靠性和透明度的复杂表格分析场景
近年来,表格推理受到广泛关注,尤其在大型语言模型(LLMs)的推动下,自然语言应用取得突破。现有基于LLM的方法虽能实现基于任务语义的逐步思考,但往往忽视推理过程中的系统性思维,导致步骤遗漏、逻辑混乱和错误结果,尤其在复杂场景中问题更突出。本文提出PoTable,一种面向表格推理的阶段式规划-执行方法,融入系统性思考。PoTable包含多个具有明确目标的分析阶段,每个阶段先制定操作链计划,再通过代码生成、实时运行与反馈处理逐项执行。该机制使推理结果具备高精度、分步注释和完全可执行的程序特性,模拟专业数据分析师的工作流程,在准确率与可解释性方面均具优势。我们在WikiTQ和TabFact的四个数据集上进行了大量实验,结果验证了PoTable在有效性、效率和可解释性方面的优越性。代码已开源:https://github.com/Double680/PoTable。
原文摘要 · Abstract (English)
In recent years, table reasoning has garnered substantial research interest, particularly regarding its integration with Large Language Models (LLMs), which have revolutionized natural language applications. Existing LLM-based studies typically achieve step-by-step thinking for table reasoning guided by task semantics. While these approaches emphasize autonomous exploration and enhance fine-grained table understanding, they often overlook systematic thinking in the reasoning process. This oversight can lead to omitted steps, disorganized logic and misleading results, especially in complex scenarios. In this paper, we propose PoTable, a novel stage-oriented plan-then-execute approach that incorporates systematic thinking into table reasoning. Specifically, PoTable involves several distinct analytical stages with clear objectives to provide adequate guidance. To accomplish stage-specific goals, PoTable employs a plan-then-execute mechanism: it first plans the operation chain based on the stage objective, and then executes operations sequentially through code generation, real-time running and feedback processing. Consequently, PoTable produces reliable table reasoning results with highly accurate, step-wise commented and completely executable programs. It mirrors the workflow of a professional data analyst, offering advantages in both accuracy and explainability. Finally, we conduct extensive experiments on four datasets from the WikiTQ and TabFact benchmarks, where the results demonstrate the effectiveness, efficiency and explainability of PoTable. Our code is available at: https://github.com/Double680/PoTable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。