用轻量模型和规则流程,高效识别电子表格中的单元格类型与表格范围。
Structured Prediction for Scalable Spreadsheet Table Understanding: From Cell Types to Table Ranges (Extended Version)
- 先用LightGBM+CRF预测单元格类型,保证空间一致性。
- 通过五步规则流程从类型预测结果中提取表格边界,准确率达0.937。
- 适合需要低资源、高可解释性的表格自动化场景。
电子表格是发布表格数据的主要媒介,但因布局多样、格式不一、组织规范不统一,自动提取结构化内容仍具挑战。本文解决两个核心任务:单元格类型分类(CTC)和表格检测(TD)。提出一种高效的两阶段流水线:先用基于65个结构化特征的LightGBM分类器结合成对条件随机场(pairwise CRF)进行细胞类型预测,确保网格空间一致性;再通过确定性五阶段流程,从预测结果中提取表格范围。为评估构建并公开了StatSheets基准数据集,包含来自14个国际数据源的737张手动标注表格,覆盖多种语言和文件格式。在5折交叉验证下,该方法在CTC任务上取得0.937的平均文件宏F1分数,仅比基于GPU的TUTA Transformer低0.6个百分点,但资源消耗显著更低。在TD任务上,其确定性方法优于基于区域的基线,并与近期的LLM-based系统如SpreadsheetLLM相当。结果表明,结合非线性结构化预测与确定性范围提取,可实现高效、可扩展的表格理解方案。
原文摘要 · Abstract (English)
Spreadsheets are a primary medium for publishing tabular data, yet automatically extracting structured content from them remains difficult due to heterogeneous layouts, diverse file formats, and inconsistent organizational conventions. We address two core tasks in spreadsheet understanding: Cell-Type Classification (CTC), which assigns roles to cells, and Table Detection (TD), which identifies table bounding boxes within sheets. We propose an efficient two-stage pipeline in which a learned CTC model feeds a deterministic TD algorithm. For CTC, we use a LightGBM classifier over 65 structured features together with a pairwise CRF enforcing spatial consistency across the cell grid. Our TD method extracts table ranges from predicted cell types by a deterministic five-stage procedure. For evaluation, we built and share StatSheets, a multilingual benchmark of 737 manually annotated sheets from 14 public data providers across multiple countries and file formats. Under 5-fold cross-validation, our CRF-LightGBM system achieves a Mean File-Macro F1 score of 0.937 on CTC, within 0.6 percentage points of the GPU-based TUTA Transformer, while requiring substantially fewer computational resources. For TD, our deterministic approach outperforms region-based baselines and remains competitive with recent LLM-based systems such as SpreadsheetLLM. These results demonstrate that combining non-linear structured prediction with deterministic range extraction provides a competitive, scalable, and computationally efficient approach to spreadsheet table understanding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。