公开了真实道路中主流LKA系统的全量数据,揭示其在复杂路况下的安全短板。
OpenLKA: an open dataset of lane keeping assist from market autonomous vehicles
- 通过实车测试采集CAN信号、视频与轨迹数据,覆盖多种恶劣场景。
- 发现LKA对模糊标线敏感,在变道和急弯中频繁偏离或退出。
- 数据可支持自动驾驶系统优化,适合交通规划与智能驾驶研究者使用。
车道保持辅助(LKA)系统已成为近年主流汽车的标配功能。尽管被宣传为具备自动转向能力,但其实际运行特性与安全表现仍缺乏深入研究,主要受限于真实世界测试数据不足。为此,我们在美国坦帕市对多家主流车企的LKA系统进行了广泛测试。采用创新方法,收集了包含完整控制器局域网(CAN)消息及LKA属性的多模态数据,同时获取高精度前向摄像头拍摄的视频、感知输出与横向轨迹数据,并融合先进视觉检测与路径规划算法。测试涵盖复杂道路几何、恶劣天气、车道线磨损及组合场景。利用视觉语言模型(VLM)对视频进行标注,识别天气、光照与交通特征。基于该数据集,我们呈现了LKA系统运行特性的实证分析:(1)对弱标线和低路面对比度敏感;(2)在变道、分流、交叉口等场景易发生意外偏离或系统退出;(3)转向扭矩限制导致急弯时频繁偏离,存在安全隐患;(4)始终刚性居中,缺乏对急弯或大型车辆邻近场景的自适应能力。最后,我们展示了该数据集在指导道路基础设施规划与自动驾驶技术发展中的应用价值。针对现有局限,建议提升道路几何设计与路面维护水平。同时,演示了通过VLM微调与思维链推理,实现类人化LKA系统的可行性。
原文摘要 · Abstract (English)
The Lane Keeping Assist (LKA) system has become a standard feature in recent car models. While marketed as providing auto-steering capabilities, the system's operational characteristics and safety performance remain underexplored, primarily due to a lack of real-world testing and comprehensive data. To fill this gap, we extensively tested mainstream LKA systems from leading U.S. automakers in Tampa, Florida. Using an innovative method, we collected a comprehensive dataset that includes full Controller Area Network (CAN) messages with LKA attributes, as well as video, perception, and lateral trajectory data from a high-quality front-facing camera equipped with advanced vision detection and trajectory planning algorithms. Our tests spanned diverse, challenging conditions, including complex road geometry, adverse weather, degraded lane markings, and their combinations. A vision language model (VLM) further annotated the videos to capture weather, lighting, and traffic features. Based on this dataset, we present an empirical overview of LKA's operational features and safety performance. Key findings indicate: (i) LKA is vulnerable to faint markings and low pavement contrast; (ii) it struggles in lane transitions (merges, diverges, intersections), often causing unintended departures or disengagements; (iii) steering torque limitations lead to frequent deviations on sharp turns, posing safety risks; and (iv) LKA systems consistently maintain rigid lane-centering, lacking adaptability on tight curves or near large vehicles such as trucks. We conclude by demonstrating how this dataset can guide both infrastructure planning and self-driving technology. In view of LKA's limitations, we recommend improvements in road geometry and pavement maintenance. Additionally, we illustrate how the dataset supports the development of human-like LKA systems via VLM fine-tuning and Chain of Thought reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。