构建首个融合语言标注的高风险驾驶数据集,助力自动驾驶安全决策研究
A knowledge-augmented dataset of high-risk driving scenarios with LLM annotations for autonomous driving

- 用大模型生成语义标注,整合20个真实驾驶数据集中的高风险事件
- 涵盖31,398个高风险事件,含1,036个近碰撞极端案例,支持多维度分析
- 提供可验证的安全推理解析与决策建议,适合训练和评估智能驾驶系统
安全自动驾驶需要快速响应常见高风险事件,并对罕见极端长尾场景进行深度推理。这些场景在自然驾驶数据中严重缺失,现有轨迹与语言增强数据集普遍缺乏高风险事件标签、语义注释及可验证的安全信号。本文提出K-Risk,一个融合结构化驾驶轨迹与大语言模型生成语义注释的知识增强数据集,用于关键安全驾驶场景。K-Risk整合了来自欧洲、中国和美国的20个人类驾驶与自动驾驶车辆轨迹数据集,覆盖高速公路、城市快速路、交叉口和环岛等场景。通过统一的风险导向提取流程,共梳理出31,398个高风险事件,其中包含1,036个近碰撞极端事件子集。每个事件以同步的轨迹、元数据和语言三元组形式发布,包含结构化场景描述、异常行为告警,以及代表性样本的因果风险分析与行动建议,均通过闭环模拟器与迭代反思机制验证。通过结合多维风险标注、可解释的语言监督与可验证决策,K-Risk实现了结构化交通轨迹、语义推理与决策监督的桥梁作用,为下一代风险感知自动驾驶代理的研发与评估提供了标准化基础。
原文摘要 · Abstract (English)
Safe autonomous driving requires both rapid responses to common high-risk events and deeper reasoning over rare, extreme long-tail scenarios in traffic safety. These scenarios are severely under-represented in naturalistic driving data, and existing trajectory and language-augmented datasets seldom provide high-risk event labels, semantic annotations, and verifiable safety signals. Here we present K-Risk, a knowledge-augmented dataset that combines structured driving trajectories with large language model generated semantic annotations for safety-critical driving scenarios. K-Risk integrates 20 human-driven and autonomous-vehicle trajectory datasets from Europe, China, and the United States, covering highways, urban freeways, intersections, and roundabouts. Using a unified risk-centric extraction pipeline, K-Risk curates 31,398 high-risk events, together with a 1,036-event extreme subset of near-collision cases. Each event is released as a synchronized trajectory, metadata, and language triplet containing structured scenario descriptions, abnormal-behavior notifications, and, for a representative subset, causal risk analyses and action recommendations validated through a closed-loop simulator with iterative reflection. By combining multi-dimensional risk annotations, interpretable language supervision, and verifiable decisions, K-Risk bridges structured traffic trajectories, semantic reasoning, and decision supervision, providing a standardized foundation for developing and evaluating next-generation risk-aware autonomous driving agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。