arXiv:2606.29905cs.CV2026-06被引 4

通过分步结构监督和分解奖励,提升表格解析的准确性与稳定性。

StrucTab: A Structured Optimization Framework for Table Parsing

论文配图:StrucTab: A Structured Optimization Framework for Table Parsing
图 1 · 摘自论文原文
  • 将表格解析拆解为行列表征、合并单元格分析等子任务,逐步推理。
  • 在多个公开数据集上达到顶尖性能,TableVerse-5K上显著超越现有方法。
  • 适合需要高精度表格结构理解的研究者与开发者使用。

表格解析旨在将表格图像转换为结构化、可机器读取的表示,需同时理解复杂的空间布局与文本内容。尽管近期视觉语言模型(VLMs)实现端到端解析,但通常依赖最终输出的直接监督,忽略了对复杂表格结构至关重要的中间推理过程。此外,利用强化学习(RL)优化时,常因奖励设计不稳定或模糊而受限。为此,我们提出StrucTab,一种通过中间结构监督与奖励分解训练的表格解析模型。在建模层面,通过将解析过程分解为人类启发的子任务(如行列计数、合并单元格分析),并采用序列推理策略逐步整合;在优化层面,引入Uni-TabRL统一强化学习框架,利用分解后的奖励(有效性、结构、内容)提供稳定且信息丰富的优化信号;在评估层面,构建TableVerse-5K——一个大规模、具有挑战性的基准,涵盖多样真实场景。大量实验表明,StrucTab在所有公开基准上均达领先水平,并在TableVerse-5K上实现显著提升,验证了显式结构建模与分解奖励优化的有效性。代码与基准已开源于https://github.com/VirtualLUOUCAS/StrucTab。

原文摘要 · Abstract (English)

Table parsing aims to convert table images into structured, machine-readable representations, a task requiring the joint perception of complex spatial layouts and textual content. While recent vision-language models (VLMs) enable end-to-end parsing, they typically rely on direct supervision of the final output, thereby bypassing the explicit intermediate reasoning that is crucial for understanding complex table structures. Furthermore, attempts to optimize these models using reinforcement learning (RL) are often hindered by unstable or ambiguous reward designs, limiting potential performance gains. To address these limitations, we propose StrucTab, a table parsing model learned through intermediate structural supervision and reward decomposition. At the modeling level, by decomposing the parsing process into human-inspired subtasks, such as row-column counting and merged-cell analysis, StrucTab progressively unifies them through a sequential reasoning strategy. At the optimization level, we introduce Uni-TabRL, a unified RL framework that leverages decomposed rewards (validity, structure, and content) to provide stable and informative optimization signals. Finally, at the evaluation level, we present TableVerse-5K, a large-scale, challenging benchmark encompassing diverse, real-world table scenarios. Extensive experiments demonstrate the state-of-the-art performance of StrucTab across all evaluated public benchmarks and significant improvements on TableVerse-5K, validating the effectiveness of explicit structural modeling and decomposed reward optimization. Code and benchmark are publicly available at https://github.com/VirtualLUOUCAS/StrucTab.

表格解析结构建模强化学习视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。