提出首个自动化隐式工具投毒框架,可隐蔽操控智能体执行恶意操作。
MCP-ITP: An Automated Framework for Implicit Tool Poisoning in MCP
- 将投毒生成建模为黑箱优化,通过反馈迭代提升攻击成功率。
- 在12个智能体上实现最高84.2%攻击成功率,检测率低至0.3%。
- 适用于研究模型安全与对抗攻击的开发者和安全研究人员。
为标准化基于大语言模型的智能体与其环境的交互,模型上下文协议(MCP)被提出并广泛应用。然而,集成外部工具扩大了攻击面,使智能体面临工具投毒攻击。此类攻击中,恶意指令嵌入工具元数据,在MCP注册阶段注入智能体上下文,从而操纵其行为。现有工作主要关注显式投毒或依赖人工构造的投毒工具。本文聚焦更隐蔽的隐式工具投毒:投毒工具本身不被调用,而是通过元数据中的指令诱导智能体调用合法但高权限工具执行恶意操作。我们提出MCP-ITP,首个面向MCP生态的自动化、自适应隐式投毒框架。该框架将投毒工具生成建模为黑箱优化问题,采用迭代优化策略,利用评估大模型与检测大模型的反馈,最大化攻击成功率(ASR)的同时规避现有检测机制。在包含12个大模型智能体的MCPTox数据集上的实验表明,MCP-ITP持续优于人工基线,最高达到84.2%的ASR,同时将恶意工具检测率(MDR)压制至0.3%。
原文摘要 · Abstract (English)
To standardize interactions between LLM-based agents and their environments, the Model Context Protocol (MCP) was proposed and has since been widely adopted. However, integrating external tools expands the attack surface, exposing agents to tool poisoning attacks. In such attacks, malicious instructions embedded in tool metadata are injected into the agent context during MCP registration phase, thereby manipulating agent behavior. Prior work primarily focuses on explicit tool poisoning or relied on manually crafted poisoned tools. In contrast, we focus on a particularly stealthy variant: implicit tool poisoning, where the poisoned tool itself remains uninvoked. Instead, the instructions embedded in the tool metadata induce the agent to invoke a legitimate but high-privilege tool to perform malicious operations. We propose MCP-ITP, the first automated and adaptive framework for implicit tool poisoning within the MCP ecosystem. MCP-ITP formulates poisoned tool generation as a black-box optimization problem and employs an iterative optimization strategy that leverages feedback from both an evaluation LLM and a detection LLM to maximize Attack Success Rate (ASR) while evading current detection mechanisms. Experimental results on the MCPTox dataset across 12 LLM agents demonstrate that MCP-ITP consistently outperforms the manually crafted baseline, achieving up to 84.2% ASR while suppressing the Malicious Tool Detection Rate (MDR) to as low as 0.3%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。