让大模型学会像人一样分步推理表格,提升复杂查询准确率。
Evolving from Lessons: Skill-Augmented Table Graph Reasoning for Operation-wise Table Question Answering

- 将表格转为图结构,动态规划推理路径,避免信息丢失。
- 通过积累成功与失败经验,实现模型自我进化,复杂操作准确率提升6.03%。
- 适合需要精细表格推理的场景,如数据分析、智能问答系统。
表格问答(TableQA)旨在通过对表格进行推理以回答用户问题。现有研究对所有问题一视同仁,仅以整体准确率评估,掩盖了大语言模型在简单查表上表现优异,但在聚合和算术等复杂操作上表现不佳的关键现实。为此,我们提出新的“按操作类型划分的表格问答”任务,构建细粒度问题分类体系,并发布两个数据集WikiTQ-ow和TabFact-ow用于评估。针对建模瓶颈,现有方法将表格线性化为文本,破坏其原有结构,导致“中间信息丢失”问题,阻碍跨行复杂推理;且通常从头开始推理,忽视相似操作间的可复用模式。为此,我们提出技能增强型表格图推理(SkillTGR)框架,实现自演化结构化推理。具体而言,SkillTGR将表格表示为带属性的图,显式保留行列单元格结构,由大模型规划并执行动态链路,检索证据子图进行图遍历推理。在此基础上,SkillTGR基于认知启发式,构建层次化技能库,将推理轨迹抽象为通用技能,并混合检索成功与失败技能,实现对比增强的图推理,从而支持持续自我进化。大量实验表明,SkillTGR在整体平均准确率上提升5.91%,操作级提升6.03%,同时减少19.76%的令牌消耗和27.64%的推理延迟。代码与数据将在发表后公开。
原文摘要 · Abstract (English)
Table Question Answering (TableQA) aims to reason over tables to answer user queries. Existing research treats all questions uniformly and evaluates solely through overall accuracy, obscuring a critical reality that LLMs excel at simple lookups yet struggle with complex operations like aggregation and arithmetic. To reveal this disparity, we introduce a novel \emph{Operation-wise TableQA} task with a fine-grained question taxonomy and release two datasets named WikiTQ-ow and TabFact-ow for evaluation. As for modeling bottlenecks, existing methods flatten tables into linearized texts, disrupting inherent structures and inducing the ``lost-in-the-middle'' issue, which poses a primary barrier to complex cross-row reasoning. Moreover, they typically reason from scratch, neglecting reusable patterns shared across similar operations. To address these limitations, we propose a Skill-augmented Table Graph Reasoning (SkillTGR) framework for self-evolving structured reasoning. Specifically, SkillTGR represents tables as attributed graphs with explicit row-column-cell structures, where LLMs plan and execute dynamic chains to retrieve evidence subgraphs for graph traversal reasoning. Based on this, SkillTGR builds a hierarchical SkillBank to distill reason trajectories into abstract skills under cognitive heuristics, then hybrid retrieves both successful and failed skills for contrastive augmented table graph reasoning, thereby enabling the continual self-evolution. Extensive experiments demonstrate that SkillTGR achieves superior performance with an average of 5.91\% overall and 6.03\% operation-wise improvement, also reducing 19.76\% token consumption and 27.64\% inference latency. Our codes and data will be released upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。