arXiv:2509.16391cs.LGcs.AI2025-09NeurIPS被引 1

用对比学习让模型自动遗忘特定数据,效果优于现有方法。

CoUn: Empowering Machine Unlearning via Contrastive Learning

  • 通过对比学习调整数据表征,利用语义相似性间接弱化忘记数据。
  • 在多个数据集和模型上,遗忘效果显著优于当前最佳基线。
  • 可插拔模块,能提升已有遗忘方法的性能,适合隐私保护场景。

机器遗忘(MU)旨在移除训练模型中特定“遗忘”数据的影响,同时保留对其他“保留”数据的知识。现有基于标签修改或模型权重扰动的方法往往遗忘效果有限。为此,我们提出CoUn,一种受启发于仅用保留数据重新训练模型时,遗忘数据会因语义相似性被错误分类现象的新框架。CoUn通过仅对保留数据应用对比学习(CL)和监督学习,模拟这一行为:(1) 利用样本间语义相似性,间接调整遗忘数据的表征;(2) 通过监督学习保持保留数据表征在其类别簇内。大量实验表明,CoUn在多种数据集和模型架构下均持续优于现有最先进基线。此外,将我们的对比学习模块集成到现有基线中,可显著增强其遗忘能力。

原文摘要 · Abstract (English)

Machine unlearning (MU) aims to remove the influence of specific "forget" data from a trained model while preserving its knowledge of the remaining "retain" data. Existing MU methods based on label manipulation or model weight perturbations often achieve limited unlearning effectiveness. To address this, we introduce CoUn, a novel MU framework inspired by the observation that a model retrained from scratch using only retain data classifies forget data based on their semantic similarity to the retain data. CoUn emulates this behavior by adjusting learned data representations through contrastive learning (CL) and supervised learning, applied exclusively to retain data. Specifically, CoUn (1) leverages semantic similarity between data samples to indirectly adjust forget representations using CL, and (2) maintains retain representations within their respective clusters through supervised learning. Extensive experiments across various datasets and model architectures show that CoUn consistently outperforms state-of-the-art MU baselines in unlearning effectiveness. Additionally, integrating our CL module into existing baselines empowers their unlearning effectiveness.

机器遗忘对比学习隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。