arXiv:2603.15033cs.LG2026-03被引 3

模型设计即遗忘:通过删键实现零样本删除,无需重训练

Rethinking Machine Unlearning: Models Designed to Forget via Key Deletion

  • 将遗忘能力嵌入模型结构,用专属密钥存储记忆信息
  • 在图像、细粒度识别和医疗数据上均超越传统方法
  • 适合需要快速响应隐私请求的部署场景

机器遗忘正成为实际需求,受隐私法规、数据错误及需移除有害样本驱动。然而现有方法多为事后处理,依赖完整训练数据进行参数更新,与真实部署中可预见的遗忘请求不匹配。本文提出‘设计即遗忘’新范式,使模型天然具备遗忘能力。我们提出MUNKEY——一种基于记忆增强的Transformer,将实例特异性记忆与模型权重解耦,遗忘仅需删除对应实例密钥,实现零样本删除,无需权重更新或原始数据。在自然图像、细粒度识别和医疗数据集上,MUNKEY全面优于所有事后方法。结果表明,设计即遗忘可实现快速、适配部署的遗忘,同时保持预测性能。

原文摘要 · Abstract (English)

Machine unlearning is rapidly becoming a practical requirement, driven by privacy regulations, data errors, and the need to remove harmful or corrupted training samples. Despite this, most existing methods tackle the problem purely from a post-hoc perspective. They attempt to erase the influence of targeted training samples through parameter updates that typically require access to the full training data. This creates a mismatch with real deployment scenarios where unlearning requests can be anticipated, revealing a fundamental limitation of post-hoc approaches. We propose unlearning by design, a novel paradigm in which models are directly trained to support forgetting as an inherent capability. We instantiate this idea with Machine UNlearning via KEY deletion (MUNKEY), a memory augmented transformer that decouples instance-specific memorization from model weights. Here, unlearning corresponds to removing the instance-identifying key, enabling direct zero-shot forgetting without weight updates or access to the original samples or labels. Across natural image benchmarks, fine-grained recognition, and medical datasets, MUNKEY outperforms all post-hoc baselines. Our results establish that unlearning by design enables fast, deployment-oriented unlearning while preserving predictive performance.

机器遗忘记忆管理Transformer隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。