构建首个大规模夜间交通标志数据集,解决低光下识别难题
Benchmarking Nighttime Traffic Sign Recognition with Illumination-Adaptive Detection and Semantic Attribute Reasoning
- 提出自适应光照检测与语义属性推理的联合模型
- 夜间数据训练使模型性能显著提升,白天数据无法替代
- 适合自动驾驶、智能交通系统研究者使用
交通标志对道路安全和智能交通系统至关重要,但夜间识别仍缺乏研究,主要因真实世界公开数据集稀缺,难以覆盖低光照退化和干扰类别。现有基准多为日间数据,未涵盖大灯眩光、运动模糊、传感器噪声及被破坏或模糊的标志等问题。为此,我们提出INTSD,一个在印度多个地区采集的大规模夜间交通标志数据集,包含41类街景图像,涵盖多种干扰类别及复杂光照与天气条件,支持夜间场景下的目标检测与细粒度分类。为评估该数据集,我们在标准化协议下对先进检测与分类模型进行广泛测试。此外,我们提出LENS-Net,一种端到端自适应光照感知检测器,结合视觉-语言多模态分类器,通过可学习的形状与颜色嵌入进行软语义属性推理。实验表明,仅在日间数据上训练的模型在真实夜间条件下表现严重下降,而引入INTSD后,即使控制数据量,性能差距也显著缩小。结果验证了INTSD作为互补夜间训练资源的有效性,并建立了未来研究的有力基线。代码与数据集已公开。
原文摘要 · Abstract (English)
Traffic signboards are vital for road safety and intelligent transportation systems. Yet, recognizing traffic signs at night remains underexplored due to the scarcity of real-world public datasets capturing low-light degradations and distractor classes. Existing benchmarks are predominantly daytime and do not reflect challenges such as headlight glare, motion blur, sensor noise, and vandalized or ambiguous signage. To address these gaps, we introduce INTSD, a large-scale nighttime traffic sign dataset collected across diverse regions of India. INTSD contains street-level images spanning 41 traffic signboard classes, multiple distractor categories, and varied lighting and weather conditions, designed to support both detection and fine-grained classification under nighttime scenarios. To benchmark INTSD, we conduct extensive evaluations using state-of-the-art detection and classification models under standardized protocols. Additionally, we present LENS-Net, a strong baseline that integrates an end-to-end adaptive illumination-aware detector with a multimodal classifier that fuses vision-language representations with soft semantic attribute reasoning over learnable shape and color embeddings. Experiments demonstrate that models trained exclusively on daytime data fail substantially under real nighttime conditions - a gap that is recovered once INTSD is introduced in training, even when controlling for data volume. These results validate INTSD as a complementary nighttime training resource and establish competitive baselines for future research. The code and dataset are publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。