首次系统分析智能汽车中认知与跨层安全威胁
Security Risks of Agentic Vehicles: A Systematic Analysis of Cognitive and Cross-Layer Threats
- 提出个人代理与驾驶策略代理的角色架构,分层分析风险
- 发现感知、控制等上游层的小干扰可引发严重误判或危险行为
- 为当前及未来车载智能系统提供首个安全风险分析框架
智能体人工智能(Agentic AI)正被逐步引入人工驾驶和自动驾驶车辆,催生出具备记忆个性化、目标理解、战略推理和工具辅助能力的智能汽车(AgVs)。现有如OWASP智能体AI安全风险框架虽揭示了推理驱动系统的漏洞,但未针对车辆这类安全关键的网络物理系统设计,也未考虑与感知、通信、控制等其他层级的交互。本文系统分析了智能汽车中的安全威胁,涵盖OWASP式风险及来自其他层级的网络攻击对智能体层的影响。通过构建基于角色的智能汽车架构,包含个人代理与驾驶策略代理,研究智能体层自身漏洞及跨层风险,特别是上游层(如感知、控制层)引发的威胁。利用严重性矩阵与攻击链分析,揭示微小扰动如何演变为人类与自动驾驶车辆中的行为错位或不安全状态。该框架为当前及未来车辆平台中智能体人工智能的安全风险分析提供了首个结构化基础。
原文摘要 · Abstract (English)
Agentic AI is increasingly being explored and introduced in both manually driven and autonomous vehicles, leading to the notion of Agentic Vehicles (AgVs), with capabilities such as memory-based personalization, goal interpretation, strategic reasoning, and tool-mediated assistance. While frameworks such as the OWASP Agentic AI Security Risks highlight vulnerabilities in reasoning-driven AI systems, they are not designed for safety-critical cyber-physical platforms such as vehicles, nor do they account for interactions with other layers such as perception, communication, and control layers. This paper investigates security threats in AgVs, including OWASP-style risks and cyber-attacks from other layers affecting the agentic layer. By introducing a role-based architecture for agentic vehicles, consisting of a Personal Agent and a Driving Strategy Agent, we will investigate vulnerabilities in both agentic AI layer and cross-layer risks, including risks originating from upstream layers (e.g., perception layer, control layer, etc.). A severity matrix and attack-chain analysis illustrate how small distortions can escalate into misaligned or unsafe behavior in both human-driven and autonomous vehicles. The resulting framework provides the first structured foundation for analyzing security risks of agentic AI in both current and emerging vehicle platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。