arXiv:2509.17530cs.LG2025-09被引 6

提出无需数据的持续学习卸载框架,可安全删除旧任务而不影响已学知识。

An Unlearning Framework for Continual Learning

  • 用超网络生成任务专属参数,通过参数对齐噪声实现无数据卸载。
  • 在多个视觉数据集上连续执行学习与卸载操作,旧知识干扰极小。
  • 适合需要动态更新模型且注重隐私安全的实时应用系统。

人工智能安全与数据隐私问题日益突出,机器卸载成为潜在解决方案。然而,现有卸载算法多针对离线训练设计,难以适配持续学习(CL)中增量更新、不保留历史数据的特性。我们发现,在持续学习环境中直接使用传统卸载方法会引发两个关键问题:保留任务性能下降,以及任务复发(先前卸载的任务在后续学习中重现)。此外,多数卸载算法依赖原始数据,违背了持续学习不存储过往数据的理念。为此,我们提出UnCLe框架,采用超网络学习生成任务特定的网络参数,利用任务嵌入表示。通过将对应生成参数对齐至噪声,即可完成无数据卸载。在多个视觉数据集上的实验表明,UnCLe能高效支持多轮顺序学习与卸载操作,对已有知识影响微弱。

原文摘要 · Abstract (English)

Growing concerns surrounding AI safety and data privacy have driven the development of Machine Unlearning as a potential solution. However, current machine unlearning algorithms are designed to complement the offline training paradigm. The emergence of the Continual Learning (CL) paradigm promises incremental model updates, enabling models to learn new tasks sequentially. Naturally, some of those tasks may need to be unlearned to address safety or privacy concerns that might arise. We find that applying conventional unlearning algorithms in continual learning environments creates two critical problems: performance degradation on retained tasks and task relapse, where previously unlearned tasks resurface during subsequent learning. Furthermore, most unlearning algorithms require data to operate, which conflicts with CL's philosophy of discarding past data. A clear need arises for unlearning algorithms that are data-free and mindful of future learning. To that end, we propose UnCLe, an Unlearning framework for Continual Learning. UnCLe employs a hypernetwork that learns to generate task-specific network parameters, using task embeddings. Tasks are unlearned by aligning the corresponding generated network parameters with noise, without requiring any data. Empirical evaluations on several vision data sets demonstrate UnCLe's ability to sequentially perform multiple learning and unlearning operations with minimal disruption to previously acquired knowledge.

持续学习机器卸载无数据隐私安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。