构建首个含印章的破损假名文档数据集,助力古日文识别技术突破。
DKDS: A Benchmark Dataset of Degraded Kuzushiji Documents with Seals for Detection and Binarization
- 采集真实破损假名文档并人工标注字符与印章位置。
- 在检测任务上YOLOv5表现最佳,二值化任务中改进GAN模型效果领先。
- 适合古籍数字化、OCR算法研究者使用,推动文化遗产保护。
假名是日本前近代时期的草书体,目前仅约数千名训练有素的专家能阅读理解。随着深度学习发展,研究人员开始用光学字符识别(OCR)技术将假名转写为现代日语。尽管现有方法在干净的假名文档上表现良好,但普遍忽视了文档退化和印章等噪声对识别准确率的影响。据我们所知,尚无专门针对此类挑战的数据集。为此,本文提出「破损假名文档带印章数据集」(DKDS),作为相关任务的新基准。该数据集通过训练过的假名专家辅助构建,包含两个基准任务:(1)假名字符与印章检测;(2)文档二值化。针对检测任务,采用多个YOLO版本进行基线测试;针对二值化任务,对比传统算法、结合K均值聚类的方法、两种前沿生成对抗网络(GAN)以及我们改进的条件GAN(cGAN)方法。所有数据与基线代码已公开于https://ruiyangju.github.io/DKDS。
原文摘要 · Abstract (English)
Kuzushiji, a pre-modern Japanese cursive script, can currently be read and understood by only a few thousand trained experts in Japan. With the rapid development of deep learning, researchers have begun applying Optical Character Recognition (OCR) techniques to transcribe Kuzushiji into modern Japanese. Although existing OCR methods perform well on clean pre-modern Japanese documents written in Kuzushiji, they often fail to consider various types of noise, such as document degradation and seals, which significantly affect recognition accuracy. To the best of our knowledge, no existing dataset specifically addresses these challenges. To address this gap, we introduce the Degraded Kuzushiji Documents with Seals (DKDS) dataset as a new benchmark for related tasks. We describe the dataset construction process, which involves the assistance of a trained Kuzushiji expert, and define two benchmark tracks: (1) Kuzushiji character and seal detection and (2) document binarization. For the Kuzushiji character and seal detection track, we provide baseline results using several recent versions of YOLO to detect Kuzushiji characters and seals. For the document binarization track, we present baseline results from traditional binarization algorithms, traditional algorithms combined with K-means clustering, two state-of-the-art (SOTA) generative adversarial network (GAN) methods, and our improved conditional GAN (cGAN)-based method. The DKDS dataset and the implementation code for baseline methods are available at https://ruiyangju.github.io/DKDS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。