首个面向高速相对运动场景的事件相机碰撞时间估计数据集。
EvTTC: An Event Camera Dataset for Time-to-Collision Estimation
- 构建多传感器融合数据集,包含事件相机与标准摄像头
- 覆盖日常驾驶中多种碰撞场景,提供真实碰撞时间真值
- 适合研究高动态环境下的视觉感知与紧急制动系统
碰撞时间(TTC)估计是前向碰撞预警(FCW)的核心功能,对自动紧急制动(AEB)系统至关重要。尽管基于帧的相机(如Mobileye方案)在常规场景中表现良好,但在前方车辆速度突变或行人突然出现等极端情况下仍存在显著风险,这源于帧相机固有的曝光时间延迟。事件相机作为类生物传感新范式,具备微秒级时间分辨率,可异步报告亮度变化。为探索其在上述挑战性场景中的潜力,本文提出EvTTC,据我们所知,这是首个聚焦高相对速度下TTC任务的多传感器数据集。EvTTC包含标准相机与事件相机同步采集的数据,涵盖日常驾驶中的多种潜在碰撞场景及多类碰撞目标。同时提供LiDAR与GNSS/INS测量以计算地面真值TTC。考虑到全尺寸移动平台测试成本高昂,我们还设计并开源了小型TTC测试平台,用于实验验证与数据增强。所有数据与测试平台设计均公开,将推动基于视觉的TTC技术发展。
原文摘要 · Abstract (English)
Time-to-Collision (TTC) estimation lies in the core of the forward collision warning (FCW) functionality, which is key to all Automatic Emergency Braking (AEB) systems. Although the success of solutions using frame-based cameras (e.g., Mobileye's solutions) has been witnessed in normal situations, some extreme cases, such as the sudden variation in the relative speed of leading vehicles and the sudden appearance of pedestrians, still pose significant risks that cannot be handled. This is due to the inherent imaging principles of frame-based cameras, where the time interval between adjacent exposures introduces considerable system latency to AEB. Event cameras, as a novel bio-inspired sensor, offer ultra-high temporal resolution and can asynchronously report brightness changes at the microsecond level. To explore the potential of event cameras in the above-mentioned challenging cases, we propose EvTTC, which is, to the best of our knowledge, the first multi-sensor dataset focusing on TTC tasks under high-relative-speed scenarios. EvTTC consists of data collected using standard cameras and event cameras, covering various potential collision scenarios in daily driving and involving multiple collision objects. Additionally, LiDAR and GNSS/INS measurements are provided for the calculation of ground-truth TTC. Considering the high cost of testing TTC algorithms on full-scale mobile platforms, we also provide a small-scale TTC testbed for experimental validation and data augmentation. All the data and the design of the testbed are open sourced, and they can serve as a benchmark that will facilitate the development of vision-based TTC techniques.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。