arXiv:2606.14327cs.SEcs.AI2026-06中稿 · the Dependable AI …

评估大模型在汽车场景下的安全风险,指出当前框架难以应对实时安全挑战。

I'm Sorry Driver, I'm Afraid I Can't Do That: Appraising the Safety of LLMs within Automotive Contexts

论文配图:I'm Sorry Driver, I'm Afraid I Can't Do That: Appraising the Safety of LLMs within Automotive Contexts
图 1 · 摘自论文原文
  • 从通用大模型到车载系统部署,面临概念与工程双重难题。
  • 现有标准未覆盖大模型特有风险,如对齐问题与延迟瓶颈。
  • 提出未来保障机制,适合自动驾驶安全研究者参考。

本文从安全保证角度评估了近期将大模型集成至汽车控制任务中的各类框架。尽管大模型已在汽车领域快速应用,但现有框架在实时安全关键场景中仍面临显著挑战。首先,部署方需在下游车辆架构中验证上游由大型AI实验室开发的通用模型,存在概念性难题;其次,现有标准如ISO21448中的工程约束(如延迟)与ISO/PAS8800中的新型大模型特有问题(如对齐偏差)均未被充分解决。本文以开源项目Talk2Drive为例,开展初步实验研究,构建安全论证,揭示现有方案的局限性。鉴于大模型在汽车领域的技术探索与实际落地持续进行,本文进一步提出面向大模型相关危险事件的潜在保障机制。

原文摘要 · Abstract (English)

This paper appraises recent frameworks within AI development to integrate LLMs into control tasks in automotive contexts from the perspective of safety assurance. This work has built upon the rapid integration of LLMs across automotive settings. However, we find that at present, these frameworks face significant challenges, limiting their efficacy in real-time safety-critical contexts. Firstly, we consider conceptual challenges, including the fact that deployers are faced with a dual challenge, wherein they must assure a model which has been developed upstream, i.e. as general-purpose tools by the large AI labs, in a downstream context, i.e. into specific vehicle architectures. Secondly, we consider concrete challenges from across existing standards. We show that there are currently both fundamental engineering constraints covered in ISO21448, such as latency, and novel LLM-specific issues, such as alignment-related issues covered in ISO/PAS8800. We ground both examples in a concrete introductory, experimental case study exploring an existing open-source repository, Talk2Drive. We present a safety argument in order to make explicit the limitations of existing solutions. Nonetheless, given that the use of LLMs in automotive contexts is being explored at a technical level and operationalised, we propose potential assurance mechanisms for LLM-related hazardous events going forward.

大模型安全自动驾驶系统验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。