针对遮挡交通标志识别难题,提出新数据集与高效神经网络方案。
Training A Neural Network For Partially Occluded Road Sign Identification In The Context Of Autonomous Vehicles
- 构建含5746张图像的遮挡交通标志数据集,涵盖完全可见与部分遮挡场景。
- 自研CNN模型识别准确率达96%,迁移学习中VGG16全层解冻达99%最优。
- 仅用完整标志训练的模型在遮挡场景下性能骤降,强调真实遮挡数据重要性。
自动驾驶车辆数量增长与计算机视觉技术快速发展凸显了交通标志识别精度研究的重要性。尽管已有诸多研究取得显著成果,但当标志被树枝、广告牌等城市环境元素部分遮挡时,识别难度大幅增加。本研究探讨了部分遮挡对交通标志识别的影响,收集并公开了一个包含5,746张图像的数据集,涵盖完全可见与部分遮挡的标志。基于该数据集,我们对比了自研卷积神经网络(CNN)与迁移学习模型的表现,自研CNN达到96%准确率,而全层解冻的VGG16模型表现最佳,达到99%。额外实验表明,仅在完整标志上训练的模型在遮挡场景下识别能力显著下降。结果强调在训练集中引入真实遮挡数据对提升模型鲁棒性及保障自动驾驶安全的关键作用。
原文摘要 · Abstract (English)
The increasing number of autonomous vehicles and the rapid development of computer vision technologies underscore the particular importance of conducting research on the accuracy of traffic sign recognition. Numerous studies in this field have already achieved significant results, demonstrating high effectiveness in addressing traffic sign recognition tasks. However, the task becomes considerably more complex when a sign is partially obscured by surrounding objects, such as tree branches, billboards, or other elements of the urban environment. In our study, we investigated how partial occlusion of traffic signs affects their recognition. For this purpose, we collected a dataset comprising 5,746 images, including both fully visible and partially occluded signs, and made it publicly available. Using this dataset, we compared the performance of our custom convolutional neural network (CNN), which achieved 96% accuracy, with models trained using transfer learning. The best result was obtained by VGG16 with full layer unfreezing, reaching 99% accuracy. Additional experiments revealed that models trained solely on fully visible signs lose effectiveness when recognizing occluded signs. This highlights the critical importance of incorporating real-world data with partial occlusion into training sets to ensure robust model performance in complex practical scenarios and to enhance the safety of autonomous driving.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。