arXiv:2603.06986cs.HCcs.CV2026-03被引 3

构建首个大规模自动驾驶接管数据集,揭示接管前视觉线索的早期预警潜力。

ADAS-TO: A Large-Scale Multimodal Naturalistic Dataset and Empirical Characterization of Human Takeovers during ADAS Engagement

  • 采集327名司机22个车品牌的真实接管片段,同步视频与车载数据。
  • 发现59.3%高危接管事件前至少3秒出现可识别视觉线索。
  • 适合自动驾驶安全研究、人机交互设计及预警系统开发者参考。

接管仍是量产ADAS的关键安全风险,但现有公开资源缺乏以接管为中心的真实世界数据。本文提出ADAS-TO,首个专注于ADAS转人工驾驶的大型自然主义数据集,包含来自327名驾驶员、22个汽车品牌的15,659段20秒接管中心片段,每段同步前视视频与CAN日志。接管定义为ADAS开启→关闭的转换,主要触发原因标记为刹车、转向、油门、混合或系统退出。通过规则划分出计划内接管(Ego)与强制接管(Non-ego)。尽管多数事件发生在保守运动学范围内,仍识别出285例安全关键事件。结合运动学筛选与视觉-语言模型(VLM)标注,分析事故成因并关联干预动态。跨模态分析显示不同交通环境、基础设施退化和恶劣天气下具有明显运动学特征差异,并发现59.3%的关键事件中,可行动视觉线索在接管前至少3秒已出现,支持语义感知型早期预警的可行性。数据集已公开于huggingface.co/datasets/HenryYHW/ADAS-TO-Sample。

原文摘要 · Abstract (English)

Takeovers remain a key safety vulnerability in production ADAS, yet existing public resources rarely provide takeover-centered, real-world data. We present ADAS-TO, the first large-scale naturalistic dataset dedicated to ADAS-to-manual transitions, containing 15,659 takeover-centered 20s clips from 327 drivers across 22 vehicle brands. Each clip synchronizes front-view video with CAN logs. Takeovers are defined as ADAS ON $\rightarrow$ OFF transitions, with the primary trigger labeled as brake, steer, gas, mixed, or system disengagement. We further separate planned driver-initiated terminations (Ego) from forced takeovers (Non-ego) using a rule-based partition. While most events occur within conservative kinematic margins, we identify a long tail of 285 safety-critical cases. For these events, we combine kinematic screening with vision--language (VLM) annotation to attribute hazards and relate them to intervention dynamics. The resulting cross-modal analysis shows distinct kinematic signatures across traffic dynamics, infrastructure degradation, and adverse environments, and finds that in 59.3% of critical cases, actionable visual cues emerge at least 3s before takeover, supporting the potential for semantics-aware early warning beyond late-stage kinematic triggers. The dataset is publicly released at huggingface.co/datasets/HenryYHW/ADAS-TO-Sample.

自动驾驶接管检测多模态数据安全预警

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。