arXiv:2410.22748cs.CV2024-10被引 16

用合成数据训练交通标志识别模型,跨域表现更优。

Analysis of Classifier Training on Synthetic Data for Cross-Domain Datasets

  • 结合真实与合成图像,引入结构化阴影等新增强方法
  • 合成数据训练在跨域测试中精度提升10%(GTSRB)
  • 适合缺乏标注数据的自动驾驶场景

深度学习面临大规模训练数据获取难题,常因数据不足限制应用。为缓解此问题,采用合成图像与真实数据结合的方法成为主流。本研究聚焦智能交通系统中的基于摄像头的交通标志识别,用于高级驾驶辅助与自动驾驶。提出包含结构化阴影和高斯高光等新型增强技术的合成数据生成流程。使用知名深度学习模型,在不同数据集上对比合成与真实图像训练的效果,并提出一种新的客观比较方法。合成图像通过半监督误差引导方法生成。实验表明,合成数据训练在多数跨域测试中优于真实数据训练,尤其在GTSRB数据集上精度提升10%,显著提升模型泛化能力,降低图像采集成本。

原文摘要 · Abstract (English)

A major challenges of deep learning (DL) is the necessity to collect huge amounts of training data. Often, the lack of a sufficiently large dataset discourages the use of DL in certain applications. Typically, acquiring the required amounts of data costs considerable time, material and effort. To mitigate this problem, the use of synthetic images combined with real data is a popular approach, widely adopted in the scientific community to effectively train various detectors. In this study, we examined the potential of synthetic data-based training in the field of intelligent transportation systems. Our focus is on camera-based traffic sign recognition applications for advanced driver assistance systems and autonomous driving. The proposed augmentation pipeline of synthetic datasets includes novel augmentation processes such as structured shadows and gaussian specular highlights. A well-known DL model was trained with different datasets to compare the performance of synthetic and real image-based trained models. Additionally, a new, detailed method to objectively compare these models is proposed. Synthetic images are generated using a semi-supervised errors-guide method which is also described. Our experiments showed that a synthetic image-based approach outperforms in most cases real image-based training when applied to cross-domain test datasets (+10% precision for GTSRB dataset) and consequently, the generalization of the model is improved decreasing the cost of acquiring images.

交通标志识别合成数据跨域泛化自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。