构建首个面向自动驾驶车辆事故与险情的社交媒体视频数据集。
SAVeD: A First-Person Social Media Video Dataset for ADAS-equipped vehicle Near-Miss and Crash Event Analyses
- 从社交平台收集2119段第一视角视频,聚焦真实高危驾驶场景。
- 提出实时碰撞预警算法,量化不同道路类型下的极端风险事件。
- 提供精细标注,显著提升视觉语言模型在复杂险情中的表现。
ADAS-equipped车辆安全行为研究亟需包含多样化交通场景和高风险边缘案例(如近事故、系统失效)的真实世界数据集。然而,现有数据集多限于模拟环境或人类驾驶车辆数据,缺乏真实条件下具备ADAS功能车辆的行为记录。为此,本文提出SAVeD——一个大规模视频数据集,源自公开社交媒体内容,专门聚焦于搭载ADAS系统的车辆所发生的碰撞、近事故及系统中断事件。SAVeD包含2,119段第一人称视角视频,覆盖多样地理位置、光照与天气条件。数据集提供视频帧级标注,涵盖碰撞、避让动作与系统断开情况,支持对感知与决策失误的分析。我们通过多项分析验证其价值:(1) 提出融合语义分割与单目深度估计的框架,实现动态物体的实时碰撞时间(TTC)计算;(2) 利用广义极值分布(GEV)建模并量化不同道路类型下事故与近事故事件的极端风险;(3) 为SOTA视觉语言模型(VideoLLaMA2与InternVL2.5 HiCo R16)建立基准,表明通过领域自适应训练,利用SAVeD的精细标注可显著提升模型在复杂近事故场景中的性能。
原文摘要 · Abstract (English)
The advancement of safety-critical research in driving behavior in ADAS-equipped vehicles require real-world datasets that not only include diverse traffic scenarios but also capture high-risk edge cases such as near-miss events and system failures. However, existing datasets are largely limited to either simulated environments or human-driven vehicle data, lacking authentic ADAS (Advanced Driver Assistance System) vehicle behavior under risk conditions. To address this gap, this paper introduces SAVeD, a large-scale video dataset curated from publicly available social media content, explicitly focused on ADAS vehicle-related crashes, near-miss incidents, and disengagements. SAVeD features 2,119 first-person videos, capturing ADAS vehicle operations in diverse locations, lighting conditions, and weather scenarios. The dataset includes video frame-level annotations for collisions, evasive maneuvers, and disengagements, enabling analysis of both perception and decision-making failures. We demonstrate SAVeD's utility through multiple analyses and contributions: (1) We propose a novel framework integrating semantic segmentation and monocular depth estimation to compute real-time Time-to-Collision (TTC) for dynamic objects. (2) We utilize the Generalized Extreme Value (GEV) distribution to model and quantify the extreme risk in crash and near-miss events across different roadway types. (3) We establish benchmarks for state-of-the-art VLLMs (VideoLLaMA2 and InternVL2.5 HiCo R16), showing that SAVeD's detailed annotations significantly enhance model performance through domain adaptation in complex near-miss scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。