让车牌识别模型适应未来新格式,突破传统Transformer的语法依赖
Relaxed syntax modeling in Transformers for future-proof license plate recognition
- 设计无语法依赖的Transformer架构,减少对历史格式的过度学习
- 在真实与合成数据上,旧格式识别准确率顶尖,新格式性能几乎不下降
- 适合需要长期稳定运行的智能交通系统部署
有效的车牌识别系统需具备应对持续变化的能力,因新车牌每日上线。尽管基于Transformer的模型在初次识别时表现优异,但随时间推移性能显著下降,难以适应紧张的生产环境。此类系统在训练中见过的车牌格式上达到顶尖水平,但在未来新格式下,因字符语法变化导致可读字符被错误识别,性能接近随机猜测。通过分析Transformer编码器-解码器中的位置与上下文信息流,我们识别出其对历史语法的过度依赖。为此,提出架构剪枝与替换方案,构建了无需语法的SaLT模型,实现对车牌表示的语法无关建模。在真实与合成数据集上的实验表明,该方法在旧格式上保持顶级精度,且对新格式的性能几乎不变。多种消融实验进一步验证了架构改进的鲁棒性。
原文摘要 · Abstract (English)
Effective license plate recognition systems are required to be resilient to constant change, as new license plates are released into traffic daily. While Transformer-based networks excel in their recognition at first sight, we observe significant performance drop over time which proves them unsuitable for tense production environments. Indeed, such systems obtain state-of-the-art results on plates whose syntax is seen during training. Yet, we show they perform similarly to random guessing on future plates where legible characters are wrongly recognized due to a shift in their syntax. After highlighting the flows of positional and contextual information in Transformer encoder-decoders, we identify several causes for their over-reliance on past syntax. Following, we devise architectural cut-offs and replacements which we integrate into SaLT, an attempt at a Syntax-Less Transformer for syntax-agnostic modeling of license plate representations. Experiments on both real and synthetic datasets show that our approach reaches top accuracy on past syntax and most importantly nearly maintains performance on future license plates. We further demonstrate the robustness of our architecture enhancements by way of various ablations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。