让智能体同时清除记忆和参数中的敏感信息,防止信息回流泄露。
Agentic Unlearning: When LLM Agent Meets Machine Unlearning
- 设计双路径协同清除机制,分别处理记忆与参数中的敏感内容。
- 在医疗问答数据集上,目标隐私信息残留显著降低,且不影响正常知识保留。
- 适合需要高安全性的智能体应用,如医疗、金融等敏感场景。
本文提出「代理遗忘」(agentic unlearning),通过闭环交互实现对智能体模型参数和持久记忆中指定信息的清除。现有遗忘方法仅针对参数,存在两大缺陷:(i) 参数-记忆回流,即检索会激活参数残余或记忆片段重新引入敏感内容;(ii) 缺乏统一策略覆盖参数与记忆两条路径。我们提出同步回流遗忘(SBU)框架,联合清除参数与记忆路径。记忆路径基于依赖闭合机制,剔除孤立实体并逻辑失效共享伪影;参数路径采用随机参考对齐,引导模型输出趋向高熵先验。两条路径通过同步双更新协议集成,形成闭环机制,使记忆遗忘与参数抑制相互强化,防止跨路径污染。在医疗问答基准上的实验表明,SBU能有效降低两条路径中的目标隐私信息痕迹,且对保留数据性能影响较小。
原文摘要 · Abstract (English)
In this paper, we introduce \textbf{agentic unlearning} which removes specified information from both model parameters and persistent memory in agents with closed-loop interaction. Existing unlearning methods target parameters alone, leaving two critical gaps: (i) parameter-memory backflow, where retrieval reactivates parametric remnants or memory artifacts reintroduce sensitive content, and (ii) the absence of a unified strategy that covers both parameter and memory pathways. We present Synchronized Backflow Unlearning (SBU), a framework that unlearns jointly across parameter and memory pathways. The memory pathway performs dependency closure-based unlearning that prunes isolated entities while logically invalidating shared artifacts. The parameter pathway employs stochastic reference alignment to guide model outputs toward a high-entropy prior. These pathways are integrated via a synchronized dual-update protocol, forming a closed-loop mechanism where memory unlearning and parametric suppression reinforce each other to prevent cross-pathway recontamination. Experiments on medical QA benchmarks show that SBU reduces traces of targeted private information across both pathways with limited degradation on retained data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。