arXiv:2509.24408cs.CRcs.LG2025-09被引 2

攻击自动驾驶系统的函数库,让多智能体模型误判路况

FuncPoison: Poisoning Function Library to Hijack Multi-agent Autonomous Driving Systems

  • 用伪装指令注入恶意工具,诱导智能体误选功能
  • 可导致轨迹准确率下降,精准操控特定智能体协同出错
  • 突破现有防御,暴露函数库作为关键攻击面

自动驾驶系统越来越多依赖大型语言模型驱动的多智能体架构,各智能体通过共享函数库处理传感器数据并协同决策。该函数库虽为关键组件,却长期未被充分重视。本文提出FuncPoison,一种针对函数库的新型投毒攻击,利用智能体通过文本指令选择工具、使用标准化命令调用功能的两个弱点,注入带有欺骗性指令的恶意工具,使某智能体错误解读道路状况,引发连锁错误,误导其他智能体。在两个代表性多智能体自动驾驶系统上测试显示,该攻击可显著降低轨迹精度,灵活定位并诱导特定智能体协同失效,且能规避多种防御机制。结果表明,函数库作为看似简单的工具集,实为大模型驱动自动驾驶系统的关键攻击面,亟需关注其安全性。

原文摘要 · Abstract (English)

Autonomous driving systems increasingly rely on multi-agent architectures powered by large language models (LLMs), where specialized agents collaborate to perceive, reason, and plan. A key component of these systems is the shared function library, a collection of software tools that agents use to process sensor data and navigate complex driving environments. Despite its critical role in agent decision-making, the function library remains an under-explored vulnerability. In this paper, we introduce FuncPoison, a novel poisoning-based attack targeting the function library to manipulate the behavior of LLM-driven multi-agent autonomous systems. FuncPoison exploits two key weaknesses in how agents access the function library: (1) agents rely on text-based instructions to select tools; and (2) these tools are activated using standardized command formats that attackers can replicate. By injecting malicious tools with deceptive instructions, FuncPoison manipulates one agent s decisions--such as misinterpreting road conditions--triggering cascading errors that mislead other agents in the system. We experimentally evaluate FuncPoison on two representative multi-agent autonomous driving systems, demonstrating its ability to significantly degrade trajectory accuracy, flexibly target specific agents to induce coordinated misbehavior, and evade diverse defense mechanisms. Our results reveal that the function library, often considered a simple toolset, can serve as a critical attack surface in LLM-based autonomous driving systems, raising elevated concerns on their reliability.

自动驾驶投毒攻击LLM安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。