arXiv:2506.06112cs.LGcs.AI2025-06被引 14

提出新方法精准衡量模型删数据的彻底程度,解决现有评估难、贵、不准的问题。

Towards Lifecycle Unlearning Commitment Management: Measuring Sample-level Unlearning Completeness

  • 用插值法测量样本级删数据完成度,无需反复训练
  • 在精确和近似删除上都表现良好,仅需一个影子模型
  • 可发现过度或不足删数据的风险,适合安全合规场景

数据隐私与安全问题凸显机器遗忘的重要性——在不重新训练的情况下移除特定数据对模型的影响。当前广泛采用成员推理攻击(MIAs)外部评估遗忘效果,但存在两大缺陷:(1) 提升MIAs效能(如在线攻击)需巨大算力,常超过重训练成本;(2) MIAs专为二元包含测试设计,难以捕捉近似遗忘的细微变化。为此,我们提出插值近似测量(IAM),一种原生为遗忘推断设计的框架。IAM通过插值模型在目标样本上的泛化-拟合行为差距,量化样本级遗忘完成度。IAM在精确遗忘的二元测试中表现优异,在近似遗忘中也具高相关性,且可扩展至大模型,仅需一个预训练影子模型。我们理论分析了其评分机制的高效性。将IAM应用于近期近似遗忘算法,揭示出普遍存在的过删与欠删风险,强调近似遗忘系统需更强防护。代码已开源:https://github.com/Happy2Git/Unlearning_Inference_IAM。

原文摘要 · Abstract (English)

Growing concerns over data privacy and security highlight the importance of machine unlearning--removing specific data influences from trained models without full retraining. Techniques like Membership Inference Attacks (MIAs) are widely used to externally assess successful unlearning. However, existing methods face two key limitations: (1) maximizing MIA effectiveness (e.g., via online attacks) requires prohibitive computational resources, often exceeding retraining costs; (2) MIAs, designed for binary inclusion tests, struggle to capture granular changes in approximate unlearning. To address these challenges, we propose the Interpolated Approximate Measurement (IAM), a framework natively designed for unlearning inference. IAM quantifies sample-level unlearning completeness by interpolating the model's generalization-fitting behavior gap on queried samples. IAM achieves strong performance in binary inclusion tests for exact unlearning and high correlation for approximate unlearning--scalable to LLMs using just one pre-trained shadow model. We theoretically analyze how IAM's scoring mechanism maintains performance efficiently. We then apply IAM to recent approximate unlearning algorithms, revealing general risks of both over-unlearning and under-unlearning, underscoring the need for stronger safeguards in approximate unlearning systems. The code is available at https://github.com/Happy2Git/Unlearning_Inference_IAM.

机器遗忘隐私保护评估方法大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。