arXiv:2510.18123cs.CVcs.AI2025-10被引 4

用自然语言提升自动驾驶协作安全,首次系统解决语言通信漏洞。

SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Driving

  • 构建语言驱动的协同驾驶安全框架,集成语义防火墙与多源验证
  • 在32种危险场景中使驾驶得分提升69.15%,恶意攻击检测F1达67.32%
  • 适合自动驾驶安全研究者与智能交通系统开发者参考

协同驾驶系统通过车与万物(V2X)通信在多个智能体间共享信息以提升安全与效率。传统V2X系统使用原始传感器数据、神经特征或感知结果作为通信媒介,存在带宽高、语义丢失和互操作性差等问题。近期研究探索将自然语言作为通信媒介,可实现语义丰富、决策级推理与人机互操作,且显著降低带宽需求。然而这一范式也引入新风险,包括消息丢失、幻觉、语义篡改和对抗攻击。本文首次系统研究基于自然语言的协同驾驶全栈安全与安全性问题,提出包含连接中断、中继重放干扰、内容伪造、多连接伪造在内的攻击分类。为应对风险,我们设计了名为SafeCoop的代理防御流水线,融合语义防火墙、语言-感知一致性检验与多源共识机制,并通过代理转换函数实现跨帧空间对齐。我们在封闭环CARLA仿真中系统评估SafeCoop,在32个关键场景下实现69.15%的驾驶得分提升,恶意攻击检测最高达67.32% F1值。本研究为推进语言驱动交通协同系统的安全可信发展提供指导。

原文摘要 · Abstract (English)

Collaborative driving systems leverage vehicle-to-everything (V2X) communication across multiple agents to enhance driving safety and efficiency. Traditional V2X systems take raw sensor data, neural features, or perception results as communication media, which face persistent challenges, including high bandwidth demands, semantic loss, and interoperability issues. Recent advances investigate natural language as a promising medium, which can provide semantic richness, decision-level reasoning, and human-machine interoperability at significantly lower bandwidth. Despite great promise, this paradigm shift also introduces new vulnerabilities within language communication, including message loss, hallucinations, semantic manipulation, and adversarial attacks. In this work, we present the first systematic study of full-stack safety and security issues in natural-language-based collaborative driving. Specifically, we develop a comprehensive taxonomy of attack strategies, including connection disruption, relay/replay interference, content spoofing, and multi-connection forgery. To mitigate these risks, we introduce an agentic defense pipeline, which we call SafeCoop, that integrates a semantic firewall, language-perception consistency checks, and multi-source consensus, enabled by an agentic transformation function for cross-frame spatial alignment. We systematically evaluate SafeCoop in closed-loop CARLA simulation across 32 critical scenarios, achieving 69.15% driving score improvement under malicious attacks and up to 67.32% F1 score for malicious detection. This study provides guidance for advancing research on safe, secure, and trustworthy language-driven collaboration in transportation systems. Our project page is https://xiangbogaobarry.github.io/SafeCoop.

自动驾驶语言通信安全防御协同驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。