arXiv:2512.01348cs.CV2025-12被引 1

针对低资源语言的段落级手写文本识别,提出无需分段的ViT-Transformer模型。

Handwritten Text Recognition for Low Resource Languages

  • 采用ViT+Transformer解码器+预训练语言模型架构,实现端到端识别。
  • 在印地语和乌尔都语数据集上达到94.8%~96.2%的字符识别率。
  • 适合缺乏标注数据的低资源手写体识别任务,尤其对南亚语言有实用价值。

尽管手写文本识别取得显著进展,但段落级手写文本识别,尤其是在低资源语言(如印地语、乌尔都语等)中仍面临挑战。这些语言通常缺乏完整语言资源,需专门设计鲁棒的光学字符识别系统。本文提出BharatOCR,一种无分段的段落级印地语与乌尔都语手写文本识别模型。该模型采用视觉变换器(ViT)提取视觉特征,使用变压器解码器生成文本序列,并结合预训练语言模型(LM)提升输出准确性、流畅性与连贯性。研究中引入用于掩码图像建模的数据高效图像变换器(DeiT),并采用优化的掩码语言建模(MLM)RoBERTa架构增强语言理解与生成能力。模型通过逐行隐式分段方式处理段落图像。在自建数据集(Parimal Urdu、Parimal Hindi)及两个公开数据集上评估,于NUST-UHWR、PUCIT-OUHL和Parimal-Urdu数据集上分别取得96.24%、92.05%、94.80%的字符识别率;在印地语数据集上达80.64%,优于多个现有方法。

原文摘要 · Abstract (English)

Despite considerable progress in handwritten text recognition, paragraph-level handwritten text recognition, especially in low-resource languages, such as Hindi, Urdu and similar scripts, remains a challenging problem. These languages, often lacking comprehensive linguistic resources, require special attention to develop robust systems for accurate optical character recognition (OCR). This paper introduces BharatOCR, a novel segmentation-free paragraph-level handwritten Hindi and Urdu text recognition. We propose a ViT-Transformer Decoder-LM architecture for handwritten text recognition, where a Vision Transformer (ViT) extracts visual features, a Transformer decoder generates text sequences, and a pre-trained language model (LM) refines the output to improve accuracy, fluency, and coherence. Our model utilizes a Data-efficient Image Transformer (DeiT) model proposed for masked image modeling in this research work. In addition, we adopt a RoBERTa architecture optimized for masked language modeling (MLM) to enhance the linguistic comprehension and generative capabilities of the proposed model. The transformer decoder generates text sequences from visual embeddings. This model is designed to iteratively process a paragraph image line by line, called implicit line segmentation. The proposed model was evaluated using our custom dataset ('Parimal Urdu') and ('Parimal Hindi'), introduced in this research work, as well as two public datasets. The proposed model achieved benchmark results in the NUST-UHWR, PUCIT-OUHL, and Parimal-Urdu datasets, achieving character recognition rates of 96.24%, 92.05%, and 94.80%, respectively. The model also provided benchmark results using the Hindi dataset achieving a character recognition rate of 80.64%. The results obtained from our proposed model indicated that it outperformed several state-of-the-art Urdu text recognition methods.

手写识别低资源语言ViT无分段

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。