无需重训练即可实时删除数据影响,保护隐私又不损模型性能。
On-the-go Forgetting without Explicit Unlearning via ERASE

- 通过特定输入扰动实现推理时遗忘,不修改模型权重。
- 在多个数据集上保持遗忘效果与保留精度的最优平衡。
- 适合需要持续更新、注重隐私合规的机器学习场景。
现有遗忘方法通常依赖权重调整或知识蒸馏,导致内存冗余、泛化能力下降且扩展性差。本文提出ERASE(基于重建对抗信号编辑的擦除),一种在推理阶段实现即时遗忘的框架,通过结构化、类别条件的输入扰动,在不修改模型权重的前提下抑制私有数据的可观察影响。我们严格分析了在特定条件下ERASE可实现指定子类别的功能遗忘,同时保持同一超类中其他子类预测不变。该分析为推断时遗忘提供了理论基础。在多种架构和基准数据集上,ERASE在遗忘效率、计算效率和保留保真度之间达到了当前最优平衡。本工作重新定义数据删除为无需显式卸载的遗忘,为持续、隐私友好的学习提供了可扩展的合规路径。
原文摘要 · Abstract (English)
Existing unlearning approaches typically rely on post hoc weight adaptation or distillation, leading to duplicated memory costs, degraded generalization, and limited scalability. In this work, we introduce ERASE, Erasure via Reconstructive Adversarial Signal Editing, a framework for on-the-go forgetting that suppresses the observable influence of private data without modifying model weights. ERASE leverages structured, class-conditioned input perturbations to induce selective forgetting during inference, eliminating the need for retraining, fine-tuning, or model copies. We rigorously characterize sufficient conditions when ERASE provably achieves functional forgetting of designated subclasses while preserving predictions across other subclasses within the same superclass. This analysis offers a principled foundation for inference-time forgetting under mild regularity assumptions. Across diverse architectures and benchmark datasets, ERASE maintains the best observed balance between forgetting efficacy, computational efficiency, and retention fidelity over recent unlearning-based methods. By reimagining data removal as forgetting without unlearning, our work establishes a scalable, regulation-aligned pathway for continual, privacy-conscious learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。