轻量级模型实现实时文档检测与校正,提升OCR识别效果。
Exploring Light-Weight Object Recognition for Real-Time Document Detection
- 改造车牌检测网络,适配身份证图像检测任务
- 模型更小且更快,仍保持领先级OCR质量
- 适合需要实时文档处理的嵌入式系统应用
物体识别与文档倾斜估计在性能和效率上已取得显著进展。现有模型主要分为两类:通过增大模型提升性能,或通过缩小模型提高效率。然而,实时文档检测与校正这一关键环节仍鲜有研究,却是视觉文档自动信息提取的重要步骤。本文提出一种高效文档检测流程,在保障OCR识别质量的同时,速度优于现有方案。我们基于IWPOD-Net(原为车牌检测网络)进行改进,并在NBID(合成身份证数据集)上训练用于文档检测。通过数据增强与跨数据集验证(使用MIDV合成证件与护照数据集),探索最优训练场景。同时对比了当前主流的物体识别与倾斜估计方法。所有方法均用于检测并校正文档,再由OCR系统读取,最终通过基于Levenshtein距离的新型OCR质量度量进行评估。由于目标是提升自动信息检索效果,故以整体OCR质量作为核心指标。结果表明,即使文档校正不完美,也能达到最先进水平。我们的模型体积更小、运行更快,同时保持竞争力的OCR表现。代码已公开于https://github.com/BOVIFOCR/iwpod-doc-corners.git。
原文摘要 · Abstract (English)
Object Recognition and Document Skew Estimation have come a long way in terms of performance and efficiency. New models follow one of two directions: improving performance using larger models, and improving efficiency using smaller models. However, real-time document detection and rectification is a niche that is largely unexplored by the literature, yet it remains a vital step for automatic information retrieval from visual documents. In this work, we strive towards an efficient document detection pipeline that is satisfactory in terms of Optical Character Recognition (OCR) retrieval and faster than other available solutions. We adapt IWPOD-Net, a license plate detection network, and train it for detection on NBID, a synthetic ID card dataset. We experiment with data augmentation and cross-dataset validation with MIDV (another synthetic ID and passport document dataset) to find the optimal scenario for the model. Other methods from both the Object Recognition and Skew Estimation state-of-the-art are evaluated for comparison with our approach. We use each method to detect and rectify the document, which is then read by an OCR system. The OCR output is then evaluated using a novel OCR quality metric based on the Levenshtein distance. Since the end goal is to improve automatic information retrieval, we use the overall OCR quality as a performance metric. We observe that with a promising model, document rectification does not have to be perfect to attain state-of-the-art performance scores. We show that our model is smaller and more efficient than current state-of-the-art solutions while retaining a competitive OCR quality metric. All code is available at https://github.com/BOVIFOCR/iwpod-doc-corners.git
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。