arXiv:2412.16780cs.LGcs.CV2024-12被引 8

用输入扰动实现模型遗忘,无需重训练即可删除特定数据影响。

Forget Vectors at Play: Universal Input Perturbations Driving Machine Unlearning in Image Classification

  • 提出‘遗忘向量’,通过输入级扰动让模型忘记特定数据。
  • 遗忘向量可线性组合,适配多种未见的遗忘任务,效果媲美重训练。
  • 适用于数据合规场景,尤其适合快速响应‘被遗忘权’请求。

机器遗忘(MU)旨在从已训练模型中消除特定不想要数据的影响,对模型编辑和符合数据法规(如“被遗忘权”)至关重要。传统方法多为基于模型的,通常需重新训练或微调权重。本文提出一种全新的基于输入扰动的遗忘策略:模型权重保持不变,仅通过生成与数据无关的输入扰动——遗忘向量,实现主动遗忘。该方法可有效抵消特定数据的影响,性能与现有模型级近似遗忘方法相当。进一步探索了遗忘向量的算术操作,通过简单组合多个类别专属遗忘向量,可生成用于未知子集遗忘的新向量。大量实验验证了遗忘向量的有效性与泛化能力,在多个数据集上表现优于或接近当前最优模型方法。代码已公开于 https://github.com/Changchangsun/Forget-Vector。

原文摘要 · Abstract (English)

Machine unlearning (MU), which seeks to erase the influence of specific unwanted data from already-trained models, is becoming increasingly vital in model editing, particularly to comply with evolving data regulations like the ``right to be forgotten''. Conventional approaches are predominantly model-based, typically requiring retraining or fine-tuning the model's weights to meet unlearning requirements. In this work, we approach the MU problem from a novel input perturbation-based perspective, where the model weights remain intact throughout the unlearning process. We demonstrate the existence of a proactive input-based unlearning strategy, referred to forget vector, which can be generated as an input-agnostic data perturbation and remains as effective as model-based approximate unlearning approaches. We also explore forget vector arithmetic, whereby multiple class-specific forget vectors are combined through simple operations (e.g., linear combinations) to generate new forget vectors for unseen unlearning tasks, such as forgetting arbitrary subsets across classes. Extensive experiments validate the effectiveness and adaptability of the forget vector, showcasing its competitive performance relative to state-of-the-art model-based methods. Codes are available at https://github.com/Changchangsun/Forget-Vector.

机器遗忘输入扰动数据合规模型编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。