提出新方法让模型忘记特定数据,同时保证其他数据预测可信。
Conformal Unlearning: A New Paradigm for Unlearning in Conformal Predictors
- 设计新范式实现有统计保障的遗忘,不依赖重训练模型。
- 在图像与文本数据上验证,遗忘目标数据覆盖率显著下降。
- 适合需要合规删除用户数据或敏感信息的场景。
共形遗忘旨在使训练好的共形预测器不再覆盖具有特定共享特征的数据点,如特定标签类别、关联特定用户或属于某聚类的数据,同时保持对剩余数据的有效覆盖率。现有机器遗忘方法通常通过近似从头重新训练模型来实现,但在共形遗忘中面临严峻挑战:缺乏严谨且考虑不确定性的统计评估指标,并出现遗忘数据性能下降但其仍被共形预测器正确覆盖的现象,我们称之为“虚假共形遗忘”。为此,我们提出一种新范式,提供无需参考重训练模型的有限样本、不确定性感知的遗忘性能保证。我们形式化共形遗忘要求保留数据高覆盖率、遗忘数据高误覆盖率,引入可实践的实证评估指标,并提出优化这些共形目标的算法。在视觉与文本基准上的大量实验表明,该方法能有效移除目标信息的同时保持模型效用。
原文摘要 · Abstract (English)
Conformal unlearning aims to ensure that a trained conformal predictor miscovers data points with specific shared characteristics, such as those from a particular label class, associated with a specific user, or belonging to a defined cluster, while maintaining valid coverage on the remaining data. Existing machine unlearning methods, which typically approximate a model retrained from scratch after removing the data to be forgotten, face significant challenges when applied to conformal unlearning. These methods often lack rigorous, uncertainty-aware statistical measures to evaluate unlearning effectiveness and exhibit a mismatch between their degraded performance on forgotten data and the frequency with which that data are still correctly covered by conformal predictors-a phenomenon we term ''fake conformal unlearning''. To address these limitations, we propose a new paradigm for conformal machine unlearning that provides finite-sample, uncertainty-aware guarantees on unlearning performance without relying on a retrained model as a reference. We formalize conformal unlearning to require high coverage on retained data and high miscoverage on forgotten data, introduce practical empirical metrics for evaluation, and present an algorithm that optimizes these conformal objectives. Extensive experiments on vision and text benchmarks demonstrate that the proposed approach effectively removes targeted information while preserving utility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。