用事件相机补足热成像的标识盲区,提升夜间行车识别精度。
UTA-Sign: Unsupervised Thermal Video Augmentation via Event-Assisted Traffic Signage Sketching
- 热成像与事件相机融合,同步标注道路标识
- 在真实场景数据集上显著提升标识检测准确率
- 无需标注数据,适合自动驾驶夜间感知应用
热成像在低光照环境下能有效感知户外环境,适用于夜间自动驾驶和无人导航。然而,当物体材质相近时,热成像难以捕捉标识信息,可能带来安全隐患。相比之下,事件相机异步检测光强变化,在高速、低光交通环境中表现优异。本文提出UTA-Sign:一种无监督的热-事件视频增强方法,用于低光照环境下道路标识(如车牌、路障标志)的生成与增强。为解决热成像对标识的感知盲区及事件相机采样不均的问题,提出双强化机制,融合热帧与事件信号以实现时间上一致的标识表征。热帧提供精确运动线索,作为对齐非均匀事件信号的时间参考;事件信号则向原始热帧注入细微的标识内容,增强环境理解。该方法在真实场景采集的数据集上验证,展现出更优的标识草图质量与感知层面的检测精度提升。
原文摘要 · Abstract (English)
The thermal camera excels at perceiving outdoor environments under low-light conditions, making it ideal for applications such as nighttime autonomous driving and unmanned navigation. However, thermal cameras encounter challenges when capturing signage from objects made of similar materials, which can pose safety risks for accurately understanding semantics in autonomous driving systems. In contrast, the neuromorphic vision camera, also known as an event camera, detects changes in light intensity asynchronously and has proven effective in high-speed, low-light traffic environments. Recognizing the complementary characteristics of these two modalities, this paper proposes UTA-Sign, an unsupervised thermal-event video augmentation for traffic signage in low-illumination environments, targeting elements such as license plates and roadblock indicators. To address the signage blind spots of thermal imaging and the non-uniform sampling of event cameras, we developed a dual-boosting mechanism that fuses thermal frames and event signals for consistent signage representation over time. The proposed method utilizes thermal frames to provide accurate motion cues as temporal references for aligning the uneven event signals. At the same time, event signals contribute subtle signage content to the raw thermal frames, enhancing the overall understanding of the environment. The proposed method is validated on datasets collected from real-world scenarios, demonstrating superior quality in traffic signage sketching and improved detection accuracy at the perceptual level.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。