为文档扫描优化超分辨率,让文字识别更准。
Task-driven real-world super-resolution of document scans
- 用文字检测、识别等任务引导超分模型训练
- 在真实文档数据上检测准确率提升,图像质量不降
- 适合需要高精度文字识别的场景
单图像超分辨率旨在从单一低分辨率图像重建高分辨率图像。尽管基于深度学习的方法在模拟数据集上表现良好——这些低分辨率图像是通过降质和下采样高分辨率图像生成的——但在真实场景(如文档扫描)中往往难以泛化,因受复杂退化和语义变化影响。本文提出一种面向任务的多任务学习框架,专门优化用于光学字符识别的超分辨率网络。引入来自高层视觉任务的辅助损失函数,包括使用连接主义文本建议网络进行文本检测、通过卷积循环神经网络进行文本识别、使用Key.Net进行关键点定位以及色相一致性。为平衡多样目标,采用动态权重平均机制,根据各损失项的收敛行为自适应调整其重要性。在SRResNet架构上验证该方法,在模拟与真实文档扫描数据集上的实验表明,所提方法提升了文本检测(以交并比衡量),同时保持整体图像保真度。结果凸显多目标优化在弥合模拟训练与实际部署之间差距中的价值。
原文摘要 · Abstract (English)
Single-image super-resolution refers to the reconstruction of a high-resolution image from a single low-resolution observation. Although recent deep learning-based methods have demonstrated notable success on simulated datasets -- with low-resolution images obtained by degrading and downsampling high-resolution ones -- they frequently fail to generalize to real-world settings, such as document scans, which are affected by complex degradations and semantic variability. In this study, we introduce a task-driven, multi-task learning framework for training a super-resolution network specifically optimized for optical character recognition tasks. We propose to incorporate auxiliary loss functions derived from high-level vision tasks, including text detection using the connectionist text proposal network, text recognition via a convolutional recurrent neural network, keypoints localization using Key.Net, and hue consistency. To balance these diverse objectives, we employ dynamic weight averaging mechanism, which adaptively adjusts the relative importance of each loss term based on its convergence behavior. We validate our approach upon the SRResNet architecture, which is a well-established technique for single-image super-resolution. Experimental evaluations on both simulated and real-world scanned document datasets demonstrate that the proposed approach improves text detection, measured with intersection over union, while preserving overall image fidelity. These findings underscore the value of multi-objective optimization in super-resolution models for bridging the gap between simulated training regimes and practical deployment in real-world scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。