MFE-GAN用多尺度特征加速文档图像增强与二值化,提升效率。
MFE-GAN: Efficient GAN-based Framework for Document Image Enhancement and Binarization with Multi-scale Feature Extraction
- 引入多尺度特征提取与哈尔变换预处理,减少模型负担
- 在三个数据集上训练和推理时间显著降低,性能接近顶尖方法
- 适合需要快速部署的OCR前处理场景
文档图像增强与二值化常用于提升光学字符识别(OCR)系统的效率与准确率,因直接识别退化文档(尤其是彩色图像)效果不佳。现有方法对不同颜色通道分别训练独立生成对抗网络(GAN),虽能去噪除阴影,但导致训练与推理时间过长。为此,本文提出MFE-GAN框架,结合多尺度特征提取(MFE)、哈尔小波变换(HWT)与归一化预处理,优化输入特征。同时设计新型生成器、判别器与损失函数,并通过消融实验验证其有效性。在Benchmark、Nabuco和CMATERdb数据集上的实验表明,MFE-GAN显著缩短总训练与推理时间,性能与当前最优(SOTA)方法相当。代码已开源:https://ruiyangju.github.io/MFE-GAN。
原文摘要 · Abstract (English)
Document image enhancement and binarization are commonly performed prior to document analysis and recognition tasks for improving the efficiency and accuracy of optical character recognition (OCR) systems. This is because directly recognizing text in degraded documents, particularly in color images, often results in unsatisfactory recognition performance. To address these issues, existing methods train independent generative adversarial networks (GANs) for different color channels to remove shadows and noise, which, in turn, facilitates efficient text information extraction. However, deploying multiple GANs results in long training and inference times. To reduce both training and inference times of document image enhancement and binarization models, we propose MFE-GAN, an efficient GAN-based framework with multi-scale feature extraction (MFE), which incorporates Haar wavelet transformation (HWT) and normalization to process document images before feeding them into GANs for training. In addition, we present novel generators, discriminators, and loss functions to improve the model's performance, and we conduct ablation studies to demonstrate their effectiveness. Experimental results on the Benchmark, Nabuco, and CMATERdb datasets demonstrate that the proposed MFE-GAN significantly reduces the total training and inference times while maintaining comparable performance with respect to state-of-the-art (SOTA) methods. The implementation of this work is available at https://ruiyangju.github.io/MFE-GAN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。