提出新遗忘机制,让系统存得越少,删得越快越安全。
System-Aware Unlearning Algorithms: Use Lesser, Forget Faster
- 基于系统感知的遗忘定义,只防御有限访问权限的攻击者。
- 设计精确算法,通过选择性采样实现线性分类的快速遗忘。
- 兼顾内存、速度与精度,适合注重隐私和效率的部署场景。
机器遗忘旨在更新一个在数据集 $S$ 上训练的模型,使一组删除请求 $U \⊆ S$ 的影响最小化。传统遗忘标准要求删除后模型几乎等同于重新训练的结果,以抵御最坏情况攻击者(可恢复未删除数据)。但此类攻击者不现实。本文提出系统感知遗忘:仅需防御能访问系统内学习/删除数据的攻击者,而非全部 $S \setminus U$。基于此,我们提出一种简单直观的策略:系统存储越少,越安全且更新越快。针对线性分类,提出基于选择性采样的精确遗忘算法,并推广至一般函数类。理论分析了删除容量、准确率、内存与计算时间间的权衡。
原文摘要 · Abstract (English)
Machine unlearning addresses the problem of updating a machine learning model/system trained on a dataset $S$ so that the influence of a set of deletion requests $U \subseteq S$ on the unlearned model is minimized. The gold standard definition of unlearning demands that the updated model, after deletion, be nearly identical to the model obtained by retraining. This definition is designed for a worst-case attacker (one who can recover not only the unlearned model but also the remaining data samples, i.e., $S \setminus U$). Such a stringent definition has made developing efficient unlearning algorithms challenging. However, such strong attackers are also unrealistic. In this work, we propose a new definition, system-aware unlearning, which aims to provide unlearning guarantees against an attacker that can at best only gain access to the data stored in the system for learning/unlearning requests and not all of $S\setminus U$. With this new definition, we use the simple intuition that if a system can store less to make its learning/unlearning updates, it can be more secure and update more efficiently against a system-aware attacker. Towards that end, we present an exact system-aware unlearning algorithm for linear classification using a selective sampling-based approach, and we generalize the method for classification with general function classes. We theoretically analyze the tradeoffs between deletion capacity, accuracy, memory, and computation time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。