用AI提升乌尔都文报纸文字识别,准确率平均提高50%
From Press to Pixels: Evolving Urdu Text Recognition
- 用YOLOv11x和SwinIR模型提取文本块并增强图像质量
- 在新数据集上,Gemini-2.5-Pro错误率低至0.133,优于传统OCR
- 仅用500个样本微调GPT-4o,就实现6.13%错误率下降
本文对大型语言模型(LLMs)与传统光学字符识别(OCR)系统在乌尔都文报纸上的表现进行对比分析,针对多栏布局、低分辨率扫描及纳斯塔利克书写风格多样等挑战。通过微调YOLOv11x模型进行文章级与栏级文本块提取,并训练基于SwinIR的超分辨率模块,显著提升图像质量,使识别准确率平均提升50%。同时提出乌尔都文报纸基准数据集UNB,包含829张段落图像,共9,982句文本。结合OpenITI语料库,系统比较了传统CNN+RNN OCR与现代LLMs,提供详细的插入、删除、替换错误分析及字符混淆模式。结果显示,Gemini-2.5-Pro在UNB上表现最佳(词错误率WER 0.133),而仅用500个领域内样本微调GPT-4o即可实现6.13%的绝对错误率下降,证明了大模型对低资源、形态复杂的乌尔都文的适应性。相关数据集与模型已开源。
原文摘要 · Abstract (English)
This paper presents a comparative analysis of Large Language Models (LLMs) and traditional Optical Character Recognition (OCR) systems on Urdu newspapers, addressing challenges posed by complex multi-column layouts, low-resolution scans, and the stylistic variability of the Nastaliq script. To handle these challenges, we fine-tune YOLOv11x models for article- and column-level text block extraction and train a SwinIR-based super-resolution module that enhances image quality for downstream text recognition, improving accuracy by an average of 50%. We further introduce the Urdu Newspaper Benchmark (UNB), a manually annotated dataset for Urdu OCR comprising 829 paragraph images with a total of 9,982 sentences. Using UNB and the OpenITI corpus, we conduct a systematic comparison between traditional CNN+RNN-based OCR systems and modern LLMs, presenting detailed insertion, deletion, and substitution error analyses alongside character-level confusion patterns. We find that Gemini-2.5-Pro achieves the best performance on UNB (WER 0.133), while fine-tuning GPT-4o on just 500 in-domain samples yields a 6.13% absolute WER improvement, demonstrating the adaptability of LLMs to low-resource, morphologically complex scripts like Urdu. The UNB dataset and fine-tuned models are publicly available at https://github.com/sameearif/urdu-newspaper-benchmark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。