arXiv:2411.07901cs.CV2024-11ICCV被引 3

用傅里叶域方法提升雨雾天气下交通灯检测精度

Fourier Domain Adaptation for Traffic Light Detection in Adverse Weather

  • 在频域修改训练数据,无需改变模型结构即可适应恶劣天气
  • YOLOv8在各指标上平均提升超12%,mAP50-95最高增23.81%
  • 适合自动驾驶系统在复杂气象下的交通灯识别应用

恶劣天气下交通灯检测在ADAS系统中仍缺乏研究,现有方法依赖复杂的深度学习模型,导致训练与部署时计算开销过大。本文提出傅里叶域适配(FDA),仅通过修改训练数据实现域适应,无需调整网络结构,有效应对雨天和雾天场景。源域融合LISA与S2TLD数据集并处理类别不平衡问题;目标域通过仿真生成雨雾场景。探索半监督学习以更高效利用数据,缓解高质量数据不足及现有模型性能下降的问题。实验表明,采用FDA增强的模型在mAP50、mAP50-95、Precision和Recall上均优于基线模型。YOLOv8在所有指标上平均提升12.25%;各模型平均提升7.69%(Precision)、19.91%(Recall)、15.85%(mAP50)和23.81%(mAP50-95),验证了FDA在缓解恶劣天气影响方面的有效性,为真实场景中可靠运行提供了支持。

原文摘要 · Abstract (English)

Traffic light detection under adverse weather conditions remains largely unexplored in ADAS systems, with existing approaches relying on complex deep learning methods that introduce significant computational overheads during training and deployment. This paper proposes Fourier Domain Adaptation (FDA), which requires only training data modifications without architectural changes, enabling effective adaptation to rainy and foggy conditions. FDA minimizes the domain gap between source and target domains, creating a dataset for reliable performance under adverse weather. The source domain merged LISA and S2TLD datasets, processed to address class imbalance. Established methods simulated rainy and foggy scenarios to form the target domain. Semi-Supervised Learning (SSL) techniques were explored to leverage data more effectively, addressing the shortage of comprehensive datasets and poor performance of state-of-the-art models under hostile weather. Experimental results show FDA-augmented models outperform baseline models across mAP50, mAP50-95, Precision, and Recall metrics. YOLOv8 achieved a 12.25% average increase across all metrics. Average improvements of 7.69% in Precision, 19.91% in Recall, 15.85% in mAP50, and 23.81% in mAP50-95 were observed across all models, demonstrating FDA's effectiveness in mitigating adverse weather impact. These improvements enable real-world applications requiring reliable performance in challenging environmental conditions.

交通灯检测恶劣天气傅里叶域YOLOv8

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。