自动增强交通灯图像,提升自动驾驶检测模型测试效率与效果
TigAug: Data Augmentation for Testing Traffic Light Detection in Autonomous Driving Systems
- 基于天气、相机和灯体属性设计三类变换与两组元关系
- 在4个主流模型上验证,生成图像自然度高且能发现错误行为
- 适合自动驾驶安全测试人员及交通灯检测算法开发者
自动驾驶技术近年来快速发展,但对交通灯检测模型的自动化测试仍不足。现有方法依赖人工采集标注数据,耗时且难以覆盖多样驾驶环境。为此,本文提出TigAug,自动增强已标注的交通灯图像以支持测试。通过系统分析天气、相机参数与交通灯特性,构建两类元关系和三类变换。利用增强图像结合特定元关系检测模型异常行为,并用于重训练以提升性能。在四个先进交通灯检测模型和两个数据集上的大规模实验表明:i)TigAug有效发现检测模型缺陷;ii)生成图像高效且自然度可接受;iii)显著提升模型鲁棒性。
原文摘要 · Abstract (English)
Autonomous vehicle technology has been developed in the last decades with recent advances in sensing and computing technology. There is an urgent need to ensure the reliability and robustness of autonomous driving systems (ADSs). Despite the recent achievements in testing various ADS modules, little attention has been paid on the automated testing of traffic light detection models in ADSs. A common practice is to manually collect and label traffic light data. However, it is labor-intensive, and even impossible to collect diverse data under different driving environments. To address these problems, we propose and implement TigAug to automatically augment labeled traffic light images for testing traffic light detection models in ADSs. We construct two families of metamorphic relations and three families of transformations based on a systematic understanding of weather environments, camera properties, and traffic light properties. We use augmented images to detect erroneous behaviors of traffic light detection models by transformation-specific metamorphic relations, and to improve the performance of traffic light detection models by retraining. Large-scale experiments with four state-of-the-art traffic light detection models and two traffic light datasets have demonstrated that i) TigAug is effective in testing traffic light detection models, ii) TigAug is efficient in synthesizing traffic light images, and iii) TigAug generates traffic light images with acceptable naturalness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。