轻量模型+嵌入式部署,实现在复杂路况下实时识别车牌。
An Embedded Real-Time License Plate Recognition System for Complex Traffic Scenes

- 采用轻量卷积网络实现车牌检测与字符识别,兼顾精度与效率。
- 在斯里兰卡数据集上检测mAP达93.6%,识别准确率87.88%。
- 支持低功耗嵌入式设备运行,适合发展中国家低成本部署。
车辆牌照识别是智能交通系统的重要组成部分。本文针对发展中国家复杂、非结构化交通场景中多样车型的挑战,设计了一套嵌入式实时车牌识别系统。系统包含多车图像中的车牌检测与检测结果的字符识别两阶段,均采用轻量卷积神经网络,在准确率与效率间取得平衡。我们还构建了斯里兰卡道路图像数据集SL-LPR,涵盖发展中国家常见的多样化车型与交通状况。在该数据集上,车牌检测与字符识别模型分别达到93.6% mAP和87.88%准确率,性能可媲美大型模型在多个公开数据集上的表现。为在资源受限的嵌入式环境中实现实时性,我们使用Brevitas库进行低比特量化,并通过FINN框架在FPGA上加速模型。最终系统在Xilinx Kria KV260平台实现11.5~15.4帧/秒的端到端处理速度。结果表明,该系统可在复杂交通场景中高效完成嵌入式实时车牌识别。数据集已开源:https://github.com/sl-lpr-uom/SL-LPR.git。
原文摘要 · Abstract (English)
Vehicle license plate recognition is an integral component of intelligent transportation systems. In this work, we present an embedded real-time license plate recognition system customized for developing countries. We address the challenge of handling complex, unstructured traffic scenes with diverse vehicle types while implementing the system on an embedded platform for low-cost deployment. Our method consists of license plate detection on a multi-vehicle image, followed by character recognition on the detected license plates. Both steps use lightweight convolutional neural networks to balance accuracy and efficiency. We also introduce the SL-LPR dataset of Sri Lankan road images, which contains a variety of vehicle types and traffic conditions typically seen in developing countries. On this dataset, the license plate detection and character recognition models achieved 93.6% mAP and 87.88% accuracy, respectively, and were competitive against larger models on several public datasets. To achieve real-time performance in a resource-constrained embedded environment, we applied low-bitwidth quantization using the Brevitas library and implemented FPGA acceleration for the models using the FINN framework. The end-to-end system can operate at 11.5~FPS when implemented on the Xilinx Kria KV260 platform. These results demonstrate that our system is effective for real-time license plate recognition on an embedded device, even in complex traffic scenarios. The SL-LPR dataset is available for research use at: https://github.com/sl-lpr-uom/SL-LPR.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。