AI系统可自动识别复杂场景中的文字并分类,适用于文档管理。
Text images processing system using artificial intelligence models
- 用DBNet++检测文本,BART模型分类,流程闭环
- 在Total-Text数据集上识别率达94.62%,支持多种异常图像
- 适合文档扫描、移动办公等实际场景使用
本文提出一种文本图像分类装置,可识别图像中的文字内容,并将其分为发票、表格、信函或报告四类。支持从闪存盘、硬盘或microSD卡读取文件的图库模式,以及连接摄像头的实时视频流模式。针对光照变化、文字倾斜、弯曲、部分遮挡、低分辨率及模糊文字等现实问题进行优化。处理流程包括:图像采集与预处理、基于DBNet++的文本区域检测、使用BART模型对检测出的文本元素进行分类,最后通过Python和PyQt5编写的用户界面展示结果。各环节无缝衔接,形成完整工作流。在包含高分辨率图像的Total-Text数据集上测试十小时,文本识别准确率达到94.62%,验证了该方法在混合来源文本分类中的有效性,即使在非受控拍摄条件下亦表现良好。
原文摘要 · Abstract (English)
This is to present a text image classifier device that identifies textual content in images and then categorizes each image into one of four predefined categories, including Invoice, Form, Letter, or Report. The device supports a gallery mode, in which users browse files on flash disks, hard disk drives, or microSD cards, and a live mode which renders feeds of cameras connected to it. Its design is specifically aimed at addressing pragmatic challenges, such as changing light, random orientation, curvature or partial coverage of text, low resolution, and slightly visible text. The steps of the processing process are divided into four steps: image acquisition and preprocessing, textual elements detection with the help of DBNet++ (Differentiable Binarization Network Plus) model, BART (Bidirectional Auto-Regressive Transformers) model that classifies detected textual elements, and the presentation of the results through a user interface written in Python and PyQt5. All the stages are connected in such a way that they form a smooth workflow. The system achieved a text recognition rate of about 94.62% when tested over ten hours on the mentioned Total-Text dataset, that includes high resolution images, created so as to represent a wide range of problematic conditions. These experimental results support the effectiveness of the suggested methodology to practice, mixed-source text categorization, even in uncontrolled imaging conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。