arXiv:2506.18069cs.DLcs.CV2025-06被引 1

用深度学习自动分析早期印刷书页结构与内容,准确率超98%。

Unfolding the Past: A Comprehensive Deep Learning Approach to Analyzing Incunabula Pages

  • 构建500页自定义数据集,用YOLO11n检测文本、图片等五类元素
  • 在自建数据上训练的模型达F1=0.94,图像分类准确率98.7%
  • 适合古籍数字化、数字人文研究者使用

本文提出一种针对早期印刷书页(incunabula)的自动化分析方法。基于雅盖隆数字图书馆资源,构建了包含500页的自定义标注数据集,每页标注文本、标题、图片、表格和手写体五类内容。同时使用公开的DocLayNet数据集作为补充训练数据。采用YOLO11n和YOLO11s模型进行目标检测,仅在自建数据上训练的YOLO11n模型取得最高性能,F1值达0.94。对识别出的文本区域分别使用Tesseract和Kraken OCR,Tesseract表现更优。图片分类采用ResNet18模型,在五个子类(装饰字母、插图、其他、印章、误检)上达到98.7%准确率。此外,利用CLIP模型为插图生成语义描述。结果表明机器学习在早期印刷书分析中具有潜力,但仍需提升OCR性能与视觉内容理解能力。

原文摘要 · Abstract (English)

We developed a proof-of-concept method for the automatic analysis of the structure and content of incunabula pages. A custom dataset comprising 500 annotated pages from five different incunabula was created using resources from the Jagiellonian Digital Library. Each page was manually labeled with five predefined classes: Text, Title, Picture, Table, and Handwriting. Additionally, the publicly available DocLayNet dataset was utilized as supplementary training data. To perform object detection, YOLO11n and YOLO11s models were employed and trained using two strategies: a combined dataset (DocLayNet and the custom dataset) and the custom dataset alone. The highest performance (F1 = 0.94) was achieved by the YOLO11n model trained exclusively on the custom data. Optical character recognition was then conducted on regions classified as Text, using both Tesseract and Kraken OCR, with Tesseract demonstrating superior results. Subsequently, image classification was applied to the Picture class using a ResNet18 model, achieving an accuracy of 98.7% across five subclasses: Decorative_letter, Illustration, Other, Stamp, and Wrong_detection. Furthermore, the CLIP model was utilized to generate semantic descriptions of illustrations. The results confirm the potential of machine learning in the analysis of early printed books, while emphasizing the need for further advancements in OCR performance and visual content interpretation.

古籍数字化目标检测图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。