针对玻利维亚车牌在光照和视角变化下的识别难题,提出自适应增强的鲁棒识别框架。
BLPR: Robust License Plate Recognition under Viewpoint and Illumination Variations via Confidence-Driven VLM Fallback
- 通过几何校正与光照补偿,结合视觉语言模型按置信度触发补救
- 在真实数据上实现89.6%字符级识别准确率,显著提升复杂环境表现
- 首个公开的玻利维亚车牌数据集,适合城市交通与低资源场景研究
在非受限环境下实现鲁棒的车牌识别仍面临重大挑战,尤其在数据稀缺且视觉特征独特的地区如玻利维亚。实际条件下的光照变化和视角畸变常导致识别性能下降。为此,我们提出BLPR——一种专为玻利维亚车牌设计的深度学习车牌检测与识别(LPDR)框架。该框架基于图像条件和置信度线索,自适应地应用几何校正、光照补偿及视觉语言模型(VLM)辅助补救。系统采用在Blender生成的合成数据预训练的YOLO检测器,模拟极端视角与光照,并在拉巴斯街头采集的真实数据上微调。检测到的车牌由基于YOLO的字符识别器处理,而在不确定情况下则触发轻量级视觉语言模型(Gemma3 4B)作为置信度驱动的后备机制。我们还发布了首个公开的玻利维亚LPDR数据集,支持在多样化视角与光照条件下进行评估。系统在真实数据上实现了89.6%的字符级识别准确率,验证了其在复杂城市环境中部署的有效性。
原文摘要 · Abstract (English)
Robust license plate recognition in unconstrained environments remains a significant challenge, particularly in underrepresented regions with limited data availability and unique visual characteristics, such as Bolivia. Recognition accuracy in real-world conditions is often degraded by illumination changes and viewpoint distortion. To address these challenges, we introduce BLPR, a deep learning-based License Plate Detection and Recognition (LPDR) framework designed for Bolivian license plates. BLPR adaptively applies geometric rectification, illumination correction, and VLM-assisted fallback based on image-condition and confidence cues. The proposed system uses a YOLO-based detector pretrained on synthetic data generated in Blender to simulate extreme perspectives and lighting conditions, and is fine-tuned on street-level data collected in La Paz, Bolivia. Detected plates are processed by a YOLO-based character recognizer, while a lightweight vision-language model (Gemma3 4B) is selectively triggered in ambiguous cases as a confidence-driven fallback mechanism. We also introduce the first publicly available Bolivian LPDR dataset for academic research, supporting evaluation under diverse viewpoint and illumination conditions. The system achieves a character-level recognition accuracy of 89.6% on real-world data, demonstrating its effectiveness for deployment in challenging urban environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。