用指针机制直接定位表格结构和文本,避免传统方法的对齐错误。
TFLOP: Table Structure Recognition Framework with Layout Pointer Mechanism
- 提出指针机制,直接将文本映射到对应区域,跳过区域预测与匹配步骤。
- 在PubTabNet等三个基准上达到当前最优性能,复杂结构表识别更准确。
- 适用于带水印或非英文文档,工业场景表现稳健。
表格结构识别(TSR)旨在将表格图像转换为机器可读格式(如HTML),以支持信息检索等应用。现有方法通过识别HTML标签和文本区域来提取内容,但常因文本区域与标签对齐不准而影响效果。本文提出新框架TFLOP(基于布局指针机制的表格结构识别框架),将传统的区域预测与匹配重构为直接文本区域指针问题。TFLOP利用文本区域信息同时识别表格结构标签及其对齐文本区域,无需额外的区域匹配阶段,避免了精细后处理需求。同时引入跨度感知对比学习监督,提升复杂结构表格中的指针精度。在PubTabNet、FinTabNet和SynthTabNet等多个基准上,TFLOP均达到当前最优性能。大量实验表明,该方法不仅在标准数据集上表现优异,还在含水印、非英文等工业级文档场景中展现出良好鲁棒性。
原文摘要 · Abstract (English)
Table Structure Recognition (TSR) is a task aimed at converting table images into a machine-readable format (e.g. HTML), to facilitate other applications such as information retrieval. Recent works tackle this problem by identifying the HTML tags and text regions, where the latter is used for text extraction from the table document. These works however, suffer from misalignment issues when mapping text into the identified text regions. In this paper, we introduce a new TSR framework, called TFLOP (TSR Framework with LayOut Pointer mechanism), which reformulates the conventional text region prediction and matching into a direct text region pointing problem. Specifically, TFLOP utilizes text region information to identify both the table's structure tags and its aligned text regions, simultaneously. Without the need for region prediction and alignment, TFLOP circumvents the additional text region matching stage, which requires finely-calibrated post-processing. TFLOP also employs span-aware contrastive supervision to enhance the pointing mechanism in tables with complex structure. As a result, TFLOP achieves the state-of-the-art performance across multiple benchmarks such as PubTabNet, FinTabNet, and SynthTabNet. In our extensive experiments, TFLOP not only exhibits competitive performance but also shows promising results on industrial document TSR scenarios such as documents with watermarks or in non-English domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。