arXiv:2607.06595cs.CRcs.AI2026-07被引 2

攻击者可利用记忆漏洞操控智能代理,窃取敏感信息。

When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents

论文配图:When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents
图 1 · 摘自论文原文
  • 设计双阶段攻击:隐藏注入+记忆触发,骗过代理记忆系统。
  • 对主流代理攻击成功率超98%注入率、60%激活率。
  • 提出防御方案,降低攻击成功率同时保持代理功能。

由大语言模型驱动的个人智能代理能通过工具自主处理邮件、管理日程、推送代码等任务,且在具备长期记忆后可减少对大上下文窗口的依赖。当前长期记忆代理主要分为对话型与规划型两类,而个人助理类代理兼具两者特性,在交互不可信信息源时面临新的安全威胁。本文提出新型攻击向量GhostWriter,利用现有工具使用型代理的记忆子系统进行内存污染。该攻击分两阶段:注入阶段,攻击者发送隐蔽攻击载荷;激活阶段,被污染的记忆被调用。实验显示,该攻击在近似98%的注入率和约60%的平均激活率下对先进代理有效,根源在于缺乏安全导向的记忆治理机制。为此,我们提出Agentic Memory Sentry(AM-Sentry),结合记忆保存策略与记忆检索筛查两种防御技术。实验表明,该方案显著降低攻击成功率,同时保留代理核心能力。

原文摘要 · Abstract (English)

Personal AI agents powered by large language models can reason and act using available tools to access emails, manage calendars, and push code to remote repositories, all with minimal oversight. When augmented with long-term memory, an agent can recall specific details relevant to the current task, reducing the need for large context windows. Currently, long-term memory agents tend to fall into two distinct domains: conversational and action-planning agents. Personal assistant agents sit at the convergence of these two domains and handle sensitive information while interacting with untrusted information sources, creating previously unaccounted security vulnerabilities. In this work, we introduce the novel attack vector, GhostWriter, which exploits current memory subsystems in tool-using personal agents to poison their memory store. GhostWriter operates in two phases: injection, where an adversary sends a hidden attack payload to the target agent; and activation, in which the poisoned memory is retrieved. We show that GhostWriter achieves near-universal injection rates of approximately 98% and a high average activation rate of approximately 60% against state-of-the-art agents. This attack is possible due to the lack of security-focused memory governance. In response, we propose Agentic Memory Sentry (AM-Sentry), which leverages two mitigation techniques: a memory-saving policy and a memory-retrieval screen. Our experiments show that AM-Sentry dramatically reduces GhostWriter's success rate while preserving agent utility.

智能代理内存攻击大模型安全记忆污染

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。