arXiv:2608.16700cs.LGcs.AI2026-08

用学习方式自动掌握删数据行为,比重训快且准。

Learning to Unlearn: Machine Unlearning via Learning the Unlearning Behaviors

论文配图:Learning to Unlearn: Machine Unlearning via Learning the Unlearning Behaviors
图 1 · 摘自论文原文
  • 从设计复杂删除函数转为学习删数据的行为模式
  • 在大规模数据下准确率接近重训练,速度显著提升
  • 适用于大模型和数据密集场景,尤其适合隐私合规需求

针对隐私法规要求,现有机器删数技术通过设计复杂的去学习函数 $U$,实现从模型中移除特定数据 $D_f$,使去学习后的模型性能接近重新训练的结果 $A(D \setminus D_f)$。然而,这些方法在处理海量训练数据时计算开销巨大,复杂结构的 $U$ 成为瓶颈。受「学习优化」启发,本文提出首个基于学习的、模型无关的去学习方法——学习式去学习(L2UL)。核心思想是不再手动设计 $U$,而是从分布角度学习去学习行为,从而获得简单高效的 $U$。实验表明,L2UL 的准确率与重训练相当,效率极高,尤其在数据密集场景表现优异;同时在更大模型如 ResNet 上验证了其性能与可扩展性。

原文摘要 · Abstract (English)

Various machine unlearning techniques have been developed in response to privacy legislation requirements, enabling individuals to exercise their legal right to have their data $D_f$ removed from a machine learning model. This process is typically accomplished via the use of an unlearning function denoted as $U$. Existing methods focus on designing an intricate $U$ to unlearn $D_f \subset D$ from a previous model $A(D)$, so that the unlearned model performs as closely as possible to the retrained model $A(D \setminus D_f)$. However, these methods often suffer from high computational costs when dealing with massive training data, as the complex structures of $U$ become a bottleneck even for models with fewer parameters. Inspired by Learning to Optimize, we introduce the first learning-based model-agnostic approach, Learning-to-UnLearn (L2UL). Our core insight is to shift from manually designing $U$ to learning the unlearning behaviors from a distribution perspective, thereby acquiring a simple and efficient $U$ via learning. Our experimental results demonstrate that the accuracy achieved by L2UL is comparable to that of retraining while exhibiting impressive efficiency, particularly in data-intensive scenarios. Furthermore, we validate the performance and scalability of our method on larger models ResNet.

机器去学习隐私保护模型效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。