用深度学习自动提取尼泊尔身份证信息,准确率超96%。
Mero Nagarikta: Advanced Nepali Citizenship Data Extractor with Deep Learning-Powered Text Detection and OCR
- 用YOLOv8检测身份证图文位置,精准定位关键区域。
- 前/后页文本检测准确率分别达99.1%和96.1%,支持低质图像。
- 专为尼泊尔语优化的OCR,适合多语言、低资源场景应用。
将尼泊尔身份证等文本类身份文件转化为结构化数字格式面临挑战,主要源于尼泊尔文字特征及卡片打印对齐、对比度的细微差异。本文提出一种基于YOLOv8的文本对象检测与优化版PyTesseract OCR相结合的鲁棒系统,集成于移动端应用,可自动提取身份证正反面的关键信息,包括姓名、公民编号和出生日期。最终的YOLOv8模型在正面文本检测上达到99.1%的平均精度,背面为96.1%。经优化的PyTesseract在处理清晰与噪声背景、不同对比度图像时表现优于标准OCR。通过灰度化、去噪、边缘检测等预处理步骤,进一步提升了低质量照片下的OCR准确率。本研究拓展了多语言OCR与文档分析领域,尤其针对尼泊尔语等低资源语言,验证了先进目标检测框架与针对性优化的OCR结合在实际应用中的有效性。
原文摘要 · Abstract (English)
Transforming text-based identity documents, such as Nepali citizenship cards, into a structured digital format poses several challenges due to the distinct characteristics of the Nepali script and minor variations in print alignment and contrast across different cards. This work proposes a robust system using YOLOv8 for accurate text object detection and an OCR algorithm based on Optimized PyTesseract. The system, implemented within the context of a mobile application, allows for the automated extraction of important textual information from both the front and the back side of Nepali citizenship cards, including names, citizenship numbers, and dates of birth. The final YOLOv8 model was accurate, with a mean average precision of 99.1% for text detection on the front and 96.1% on the back. The tested PyTesseract optimized for Nepali characters outperformed the standard OCR regarding flexibility and accuracy, extracting text from images with clean and noisy backgrounds and various contrasts. Using preprocessing steps such as converting the images into grayscale, removing noise from the images, and detecting edges further improved the system's OCR accuracy, even for low-quality photos. This work expands the current body of research in multilingual OCR and document analysis, especially for low-resource languages such as Nepali. It emphasizes the effectiveness of combining the latest object detection framework with OCR models that have been fine-tuned for practical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。