融合真实与合成数据,显著提升多国车牌识别性能。
Advancing Multinational License Plate Recognition Through Synthetic and Real Data Fusion: A Comprehensive Evaluation
- 采用三种合成数据生成方法,协同提升识别效果。
- 使用少量真实数据即达先进水平,有效缓解数据不足问题。
- 筛选出兼顾准确率与速度的最优模型,适合实际部署。
自动车牌识别因广泛应用而成为研究热点。尽管近年研究尝试用合成图像提升识别效果,但仍存在诸多局限。本文通过系统评估真实与合成数据融合对车牌识别(LPR)性能的影响,对16种OCR模型在12个来自不同地区的公开数据集上进行基准测试。结果表明,大量引入合成数据可显著提升模型在同域和跨域场景下的表现。我们对比了基于模板生成、字符排列及生成对抗网络(GAN)三种合成方法,均贡献显著。三者结合产生显著协同效应,使端到端性能超越现有先进方法及商用系统。实验还验证了合成数据在数据稀缺情况下的有效性,即使仅用原数据的小部分,也能取得优异结果。最后,分析了不同模型在准确率与速度间的权衡,识别出各类场景下的最佳平衡点。
原文摘要 · Abstract (English)
Automatic License Plate Recognition is a frequent research topic due to its wide-ranging practical applications. While recent studies use synthetic images to improve License Plate Recognition (LPR) results, there remain several limitations in these efforts. This work addresses these constraints by comprehensively exploring the integration of real and synthetic data to enhance LPR performance. We subject 16 Optical Character Recognition (OCR) models to a benchmarking process involving 12 public datasets acquired from various regions. Several key findings emerge from our investigation. Primarily, the massive incorporation of synthetic data substantially boosts model performance in both intra- and cross-dataset scenarios. We examine three distinct methodologies for generating synthetic data: template-based generation, character permutation, and utilizing a Generative Adversarial Network (GAN) model, each contributing significantly to performance enhancement. The combined use of these methodologies demonstrates a notable synergistic effect, leading to end-to-end results that surpass those reached by state-of-the-art methods and established commercial systems. Our experiments also underscore the efficacy of synthetic data in mitigating challenges posed by limited training data, enabling remarkable results to be achieved even with small fractions of the original training data. Finally, we investigate the trade-off between accuracy and speed among different models, identifying those that strike the optimal balance in each intra-dataset and cross-dataset settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。