用Transformer改进历史阿拉伯手写体识别,准确率提升51%。
HATFormer: Historic Handwritten Arabic Text Recognition with Transformers
- 基于Transformer设计编码器-解码器结构,捕捉连笔字空间上下文
- 在公开历史手写数据集上达8.6%字符错误率,较基线提升51%
- 适合做低资源语言古籍数字化与文化遗产保护研究
阿拉伯手写体识别(HTR)因书写风格多样及阿拉伯文字固有特征而具挑战性,且阿拉伯手写数据集规模远小于英文。为此,本文提出HATFormer,一种基于Transformer的编码器-解码器架构,借鉴先进英文HTR模型。通过注意力机制,有效区分连笔字符、分解视觉表征并识别元音符号。针对历史手写文本,定制了图像处理器用于ViT预处理、文本分词器实现紧凑表征,并设计适应小样本数据的训练流程。在最大公开历史手写阿拉伯数据集上,HATFormer达到8.6%字符错误率(CER),较文献最佳基线提升51%;在最大私有非历史数据集上达4.2% CER。本工作验证了将英文HTR方法迁移至复杂低资源语言的可行性,推动文档数字化、信息检索与文化保存进展。
原文摘要 · Abstract (English)
Arabic handwritten text recognition (HTR) is challenging, especially for historical texts, due to diverse writing styles and the intrinsic features of Arabic script. Additionally, Arabic handwriting datasets are smaller compared to English ones, making it difficult to train generalizable Arabic HTR models. To address these challenges, we propose HATFormer, a transformer-based encoder-decoder architecture that builds on a state-of-the-art English HTR model. By leveraging the transformer's attention mechanism, HATFormer captures spatial contextual information to address the intrinsic challenges of Arabic script through differentiating cursive characters, decomposing visual representations, and identifying diacritics. Our customization to historical handwritten Arabic includes an image processor for effective ViT information preprocessing, a text tokenizer for compact Arabic text representation, and a training pipeline that accounts for a limited amount of historic Arabic handwriting data. HATFormer achieves a character error rate (CER) of 8.6% on the largest public historical handwritten Arabic dataset, with a 51% improvement over the best baseline in the literature. HATFormer also attains a comparable CER of 4.2% on the largest private non-historical dataset. Our work demonstrates the feasibility of adapting an English HTR method to a low-resource language with complex, language-specific challenges, contributing to advancements in document digitization, information retrieval, and cultural preservation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。