arXiv:2507.04771cs.CRcs.LG2025-07被引 1

提出高效且有隐私保障的模型删减方法,实现数据遗忘同时降低成本。

Efficient Unlearning with Privacy Guarantees

  • 基于隐私保护预训练模型,支持高效无损删减
  • 在4个数据集上实现与精确删减相当的效果
  • 适合需合规删除个人数据的场景

隐私保护法规(如GDPR)赋予个人要求删除其数据的权利,不仅包括数据库,也涵盖训练过的机器学习模型。机器学习中的模型删减技术应对此需求。现有方法中,虽有可保证精确遗忘的,但计算成本高;而低成本方法缺乏遗忘保障,仅适用于特定模型。本文提出高效带隐私保障的删减框架(EUPG),通过在使用$ k $-匿名或$ ε $-差分隐私等隐私模型保护的数据上预训练模型,实现删减时继承原有隐私保障。在四个异构数据集上的实验证明,该方法在保持与精确删减相当的性能的同时,显著降低计算和存储开销。代码已开源:https://github.com/najeebjebreel/EUPG。

原文摘要 · Abstract (English)

Privacy protection laws, such as the GDPR, grant individuals the right to request the forgetting of their personal data not only from databases but also from machine learning (ML) models trained on them. Machine unlearning has emerged as a practical means to facilitate model forgetting of data instances seen during training. Although some existing machine unlearning methods guarantee exact forgetting, they are typically costly in computational terms. On the other hand, more affordable methods do not offer forgetting guarantees and are applicable only to specific ML models. In this paper, we present \emph{efficient unlearning with privacy guarantees} (EUPG), a novel machine unlearning framework that offers formal privacy guarantees to individuals whose data are being unlearned. EUPG involves pre-training ML models on data protected using privacy models, and it enables {\em efficient unlearning with the privacy guarantees offered by the privacy models in use}. Through empirical evaluation on four heterogeneous data sets protected with $k$-anonymity and $ε$-differential privacy as privacy models, our approach demonstrates utility and forgetting effectiveness comparable to those of exact unlearning methods, while significantly reducing computational and storage costs. Our code is available at https://github.com/najeebjebreel/EUPG.

机器学习隐私保护模型删减

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。