arXiv:2410.09871cs.IRcs.DL2024-10被引 45

对比10款PDF解析工具在6类文档中的表现,指导选型。

A Comparative Study of PDF Parsing Tools Across Diverse Document Categories

  • 测试10种工具在6类文档的文本与表格提取能力。
  • PyMuPDF和pypdfium2文本提取最优,但科学/专利文档整体差。
  • Nougat和TATR在复杂文档中表现突出,适合高精度场景。

PDF是主流数据格式,其解析对信息抽取与检索至关重要,尤其在RAG系统兴起背景下。尽管已有多种解析工具,但其在学术论文之外的各类文档中的表现仍缺乏研究。本研究通过DocLayNet数据集,对比了10种流行工具:PyPDF、pdfminer-six、PyMuPDF、pdfplumber、pypdfium2、Unstructured、Tabula、Camelot,以及基于深度学习的Nougat和表检测模型Table Transformer(TATR)。评估涵盖文本提取与表格检测。文本提取方面,PyMuPDF和pypdfium2总体表现最佳,但在科学和专利文档中普遍表现不佳;学习型工具如Nougat在这些挑战性类别中更优。表格检测中,TATR在金融、专利、法律与法规及科学文档中领先;Camelot在招标文件中表现最好;PyMuPDF在手册类文档中最优。结果表明应根据文档类型与任务选择合适工具,为研究人员和实践者提供重要参考。

原文摘要 · Abstract (English)

PDF is one of the most prominent data formats, making PDF parsing crucial for information extraction and retrieval, particularly with the rise of RAG systems. While various PDF parsing tools exist, their effectiveness across different document types remains understudied, especially beyond academic papers. Our research aims to address this gap by comparing 10 popular PDF parsing tools across 6 document categories using the DocLayNet dataset. These tools include PyPDF, pdfminer-six, PyMuPDF, pdfplumber, pypdfium2, Unstructured, Tabula, Camelot, as well as the deep learning-based tools Nougat and Table Transformer(TATR). We evaluated both text extraction and table detection capabilities. For text extraction, PyMuPDF and pypdfium generally outperformed others, but all parsers struggled with Scientific and Patent documents. For these challenging categories, learning-based tools like Nougat demonstrated superior performance. In table detection, TATR excelled in the Financial, Patent, Law & Regulations, and Scientific categories. Table detection tool Camelot performed best for tender documents, while PyMuPDF performed superior in the Manual category. Our findings highlight the importance of selecting appropriate parsing tools based on document type and specific tasks, providing valuable insights for researchers and practitioners working with diverse document sources.

PDF解析信息抽取文档分类评测对比

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。