arXiv:2508.14797cs.CVcs.AI2025-08中稿 · publication in Com…被引 7

用多帧对齐恢复模糊车牌,识别准确率达86.44%

MF-LPR$^2$: Multi-Frame License Plate Image Restoration and Recognition using Optical Flow

  • 通过光流对齐多帧图像,避免依赖预训练先验
  • 在真实场景数据集上实现86.44%识别率,超越单帧和多帧基线
  • 适合交通监控、执法取证等低质量视频场景

车牌识别在交通执法、刑侦调查和安防中至关重要。但行车记录仪图像中的车牌常因分辨率低、运动模糊和眩光导致识别困难。现有生成模型依赖预训练先验,难以可靠恢复此类劣质图像,常引入严重伪影。为此,我们提出多帧车牌恢复与识别框架MF-LPR²,通过帧间对齐与聚合解决图像模糊问题,不依赖预训练知识。为实现精准对齐,采用先进光流估计算法,并设计检测与修正错误光流的算法,利用车牌序列的时空一致性。该方法提升图像质量与识别精度,同时保留原始证据内容。我们构建了新型真实感车牌识别数据集RLPR,包含200对低质车牌图像序列与高质伪真值图像,反映真实场景复杂性。实验表明,MF-LPR²在PSNR、SSIM、LPIPS指标上显著优于八种近期恢复模型;识别准确率达86.44%,超越最佳单帧基线(14.04%)和多帧基线(82.55%)。消融实验证实滤波与优化算法贡献显著。

原文摘要 · Abstract (English)

License plate recognition (LPR) is important for traffic law enforcement, crime investigation, and surveillance. However, license plate areas in dash cam images often suffer from low resolution, motion blur, and glare, which make accurate recognition challenging. Existing generative models that rely on pretrained priors cannot reliably restore such poor-quality images, frequently introducing severe artifacts and distortions. To address this issue, we propose a novel multi-frame license plate restoration and recognition framework, MF-LPR$^2$, which addresses ambiguities in poor-quality images by aligning and aggregating neighboring frames instead of relying on pretrained knowledge. To achieve accurate frame alignment, we employ a state-of-the-art optical flow estimator in conjunction with carefully designed algorithms that detect and correct erroneous optical flow estimations by leveraging the spatio-temporal consistency inherent in license plate image sequences. Our approach enhances both image quality and recognition accuracy while preserving the evidential content of the input images. In addition, we constructed a novel Realistic LPR (RLPR) dataset to evaluate MF-LPR$^2$. The RLPR dataset contains 200 pairs of low-quality license plate image sequences and high-quality pseudo ground-truth images, reflecting the complexities of real-world scenarios. In experiments, MF-LPR$^2$ outperformed eight recent restoration models in terms of PSNR, SSIM, and LPIPS by significant margins. In recognition, MF-LPR$^2$ achieved an accuracy of 86.44%, outperforming both the best single-frame LPR (14.04%) and the multi-frame LPR (82.55%) among the eleven baseline models. The results of ablation studies confirm that our filtering and refinement algorithms significantly contribute to these improvements.

车牌识别图像修复多帧处理光流对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。