arXiv:2604.00003cs.CLcs.AI2026-04

本地运行小模型+布局感知解析,高效提取学术表格文档信息

Tabular PDF Information Extraction with Local LLMs and Layout-Aware Parsing: A Reliability Evaluation

  • 结合规则匹配与本地大模型,分阶段处理表格和元数据
  • 混合方法在准确率(EM达0.99)与速度(<1秒/页)上表现最优
  • 适合资源受限环境下的学术文档自动化处理

从学术PDF中提取结构化信息极具挑战:单页常混杂自由文本元数据与表格区域,跨项目差异大,且易受Unicode编码错误干扰。本研究以印尼高等教育课程注册表(KRS)为案例,评估三种信息提取方法的可靠性:仅用LLM、基于规则+LLM的混合方案,以及基于Camelot的管道+LLM回退。实验涵盖140份文档(LLM测试)和860份文档(Camelot评估),覆盖四个不同专业的数据。使用Gemma 3、Phi 4、Qwen 2.5三个12-14B模型,在无GPU的消费级CPU上通过Ollama本地运行。采用精确匹配(EM)与莱文斯坦相似度(LS,阈值0.7)评估。结果显示,混合方法在确定性元数据提取上效率更高;而基于Camelot的管道+LLM回退方案在准确率(EM与LS达0.99-1.00)与计算效率(多数情况<1秒/页)上表现最佳。Qwen 2.5:14b在所有场景中表现最稳定。结果表明,在计算资源受限环境下,融合确定性与大模型方法是可靠高效的表格文本类PDF信息提取策略。

原文摘要 · Abstract (English)

Extracting structured information from academic PDF documents is non trivial: a single page typically combines free text metadata with tabular regions, exhibits cross program variation, and is susceptible to Unicode encoding artifacts that interfere with downstream parsing. This study evaluates the reliability of information extraction approaches for tabular PDF documents, using academic course registration documents (Kartu Rencana Studi or KRS) from Indonesian higher education as a case study. Three strategies are compared: LLM only, Hybrid Deterministic - LLM (regex & LLM), and a Camelot based pipeline with LLM fallback. Experiments were conducted on 140 documents for the LLM based test and 860 documents for the Camelot based pipeline evaluation, covering four study programs with varying data in tables and metadata. Three 12 - 14B LLM models (Gemma 3, Phi 4, and Qwen 2.5) were run locally using Ollama and a consumer grade CPU without a GPU. Evaluations used exact match (EM) and Levenshtein similarity (LS) metrics with a threshold of 0.7. Although not applicable to all models, the results show that the hybrid approach can improve efficiency compared to LLM only, especially for deterministic metadata. The Camelot based pipeline with LLM fallback produced the best combination of accuracy (EM and LS up to 0.99 - 1.00) and computational efficiency (less than 1 second per PDF in most cases). The Qwen 2.5:14b model demonstrated the most consistent performance across all scenarios. These findings confirm that integrating deterministic and LLM based methods is a reliable and efficient strategy for information extraction from tabular text based PDF documents in computationally constrained environments.

PDF提取本地LLM表格识别可靠性评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。