通过符号一致合并多个微调模型,实现更稳定高效的机器遗忘。
NegMerge: Sign-Consensual Weight Merging for Machine Unlearning
- 保留所有超参数下微调模型的权重方向符号一致性,融合生成任务向量。
- 在12个数据集上超越现有方法,遗忘效果更优且计算开销更低。
- 适合需要可靠遗忘能力的场景,如隐私保护与模型合规性管理。
机器遗忘旨在从训练好的模型中选择性移除特定知识。现有方法如任务算术通过在遗忘数据集上微调模型,生成一个任务向量(即权重空间中的方向),用于从原始模型权重中减去。然而,其效果高度依赖超参数选择,需大量验证才能从多个候选向量中选出最优解。本文提出一种新方法:不依赖单一最优向量,而是利用所有不同超参数下微调得到的模型,仅保留具有相同符号的权重元素进行聚合,形成合并后的任务向量,并将其取反后应用于原模型以实现遗忘。在十二个数据集和四种骨干网络架构上的零样本及标准图像识别任务评估表明,该方法在性能上优于当前最先进方法,同时计算资源消耗相当或更少。代码已开源:https://github.com/naver-ai/negmerge。
原文摘要 · Abstract (English)
Machine unlearning aims to selectively remove specific knowledge from a trained model. Existing approaches, such as Task Arithmetic, fine-tune the model on the forget set to create a task vector (i.e., a direction in weight space) for subtraction from the original model's weight. However, their effectiveness is highly sensitive to hyperparameter selection, requiring extensive validation to identify the optimal vector from many fine-tuned candidates. In this paper, we propose a novel method that utilizes all fine-tuned models trained with varying hyperparameters instead of a single selection. Specifically, we aggregate the computed task vectors by retaining only the elements with consistent shared signs. The merged task vector is then negated to induce unlearning on the original model. Evaluations on zero-shot and standard image recognition tasks across twelve datasets and four backbone architectures show that our approach outperforms state-of-the-art methods while requiring similar or fewer computational resources. Code is available at https://github.com/naver-ai/negmerge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。