arXiv:2606.06054cs.AI2026-06被引 2

提出MemGate机制,让个人智能体记忆检索更可信,防止误导性信息干扰。

Beyond Similarity: Trustworthy Memory Search for Personal AI Agents

论文配图:Beyond Similarity: Trustworthy Memory Search for Personal AI Agents
图 1 · 摘自论文原文
  • 在向量记忆库与大模型间加入可部署的神经门控,根据任务条件筛选记忆。
  • 仅900万参数、35.1MB大小,在多种框架和模型上显著降低记忆泄露风险。
  • 无需修改模型或数据库,适合实际部署,保护智能体行为可靠性。

个人AI代理依赖长期记忆实现跨会话的个性化服务。然而现有记忆系统主要基于语义相似性检索,导致语义相关但情境不合适的记忆被调用,引发跨域泄露、阿谀奉承、工具调用漂移或记忆诱导越狱等信任威胁。本文将记忆搜索视为个人智能体的信任边界,评估A-Mem、Mem0、MemOS等主流框架及真实环境OpenClaw。结果表明,长期记忆不仅是功能层,更是持久控制通道,能重塑代理对任务的理解与执行。为此,我们提出MemGate——一种轻量级可部署的记忆插件,仅需900万参数和35.1MB内存占用。其插入于向量记忆库与主干LLM之间,无需修改模型、重写数据库或使用推理时判别器,通过查询条件神经门控将原始相似性搜索转为任务感知的记忆准入机制。在多种主流记忆框架、真实代理场景与不同LLM骨干网络中,MemGate有效缓解记忆诱发威胁,同时保持长期记忆效用。

原文摘要 · Abstract (English)

Personal AI agents increasingly rely on long-term memory to provide persistent personalization across sessions. However, existing memory pipelines are largely driven by semantic similarity: memory data close to the current query is retrieved and injected into the model context. This creates a critical trustworthiness gap, since a semantically related memory may still be contextually inappropriate, leading to threats such as cross-domain leakage, sycophancy, tool-call drift, or memory-induced jailbreaks. In this paper, we study memory search as a trust boundary in personal AI agents. We evaluate representative agentic memory frameworks, including A-Mem, Mem0, and MemOS, together with OpenClaw, a real-world personal-agent environment with persistent state and tool-use capability. Our results show that long-term memory is not merely a utility layer, but a durable control channel that can reshape how agents interpret tasks and execute actions, leaving them highly susceptible to the aforementioned threats. To mitigate these vulnerabilities, we propose MemGate, a lightweight and deployable memory plug-in for trustworthy memory search, with only 9M parameters and a 35.1MB footprint. MemGate is inserted between the vector memory store and the backbone LLM, requiring no LLM modification, memory-database rewriting, or inference-time LLM judge. It applies a query-conditioned neural gate to candidate memory representations, turning raw similarity search into task-conditioned memory admission. Across multiple mainstream memory frameworks, real-world agent settings, and diverse LLM backbones, MemGate reduces memory-induced threats while preserving long-term memory utility.

记忆机制可信AI智能体安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。