arXiv:2605.26154cs.CRcs.AI2026-05被引 5

通过污染记忆诱导大模型错误调用工具,成功率超85%。

MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning

论文配图:MemMorph: Tool Hijacking in LLM Agents via Memory Poisoning
图 1 · 摘自论文原文
  • 用伪装成技术记录的伪造数据污染长期记忆
  • 仅用3条记录即达85.9%攻击成功率
  • 可绕过主流防御,适合研究安全漏洞者

基于大模型的智能体可通过调用外部工具完成用户任务,但攻击者可能通过操纵工具元数据引导其执行恶意操作。现有攻击多聚焦于工具元数据篡改,易被审计检测,且在采用记忆模块的现代智能体中效果下降。本文提出MemMorph,首个通过污染智能体长期记忆来扭曲工具选择的攻击方法。它不直接指定调用动作,而是注入少量伪装成技术事实、事故报告和运营策略的伪造记录,重塑智能体的上下文感知与决策逻辑,使其自主推断并选择攻击者偏好的工具。在3个基准、10种智能体主干架构及3种记忆模块实现上实验表明,该方法仅需注入3条记录即可达到最高85.9%的攻击成功率,比最强基线提升25%,且在3种代表性防御下仍具有效性。研究揭示长期记忆是工具增强型智能体中关键且未受重视的攻击面,亟需建立记忆级完整性防护机制。

原文摘要 · Abstract (English)

LLM-driven agents are capable of selecting external tools to complete users' tasks. However, attackers could compromise such process, steering agents toward inappropriate/wrong tools and enabling malicious actions. Most existing attacks primarily manipulate the tool metadata, which is easily detectable by auditing and may lose effectiveness as modern agents increasingly adopt memory modules to refine tool selection policies through accumulated experience. This paper proposes MemMorph, the first attack that bias tool selection by poisoning the agent's long-term memory. Rather than explicitly dictating the tool invocation decision, MemMorph injects a small number of crafted records that are disguised as technical facts, incident reports, and operational policies. These poisoned records reshape the agent's contextual perception and decision-making process, leading it to autonomously infer and select the tool preferred by the attacker. Experiments across 3 benchmarks, 10 agent backbones, and 3 memory-module implementations show that MemMorph achieves up to 85.9% attack success rate with only three injected records, outperforming the strongest baseline by up to 25% while retaining potency under 3 representative defenses. Our findings expose long-term memory as a critical and under-explored attack surface in tool-augmented agents, urging the development of memory-level integrity safeguards.

大模型安全记忆污染工具劫持

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。