arXiv:2505.10845cs.LGcs.AI2025-05被引 2

训练时就让模型具备删数据能力,未来删除更高效。

Ready2Unlearn: A Learning-Time Approach for Preparing Models with Future Unlearning Readiness

  • 训练阶段提前注入可删数据的准备机制
  • 支持多种删法,效率比传统方法高得多
  • 适合需频繁处理用户数据删除的推荐系统

机器遗忘是指在模型训练过程中移除特定数据样本留下的影响。人工智能开发者利用机器遗忘来保护隐私、提升安全性和应对伦理问题。本文提出Ready2Unlearn,一种学习时优化方法,旨在为未来的遗忘操作做好准备。不同于多数现有工作聚焦于部署阶段的被动遗忘算法,Ready2Unlearn将视角前移至训练阶段,采用前瞻性设计。基于成熟的元学习原理,该方法主动训练模型以具备遗忘准备能力,使其在未来接到遗忘请求时能更高效、更规范地响应。该方法具有模型无关性,兼容任意基于梯度上升的遗忘算法。我们在语言与视觉任务上,针对类别级遗忘和随机数据遗忘等不同场景进行了评估。实验表明,通过在训练阶段引入这种准备机制,可生成具备遗忘就绪状态的模型,显著提升后续遗忘效率。本研究希望激发更多关于在模型中内置主动遗忘能力的探索,尤其适用于依赖用户数据进行推荐、搜索和个性化服务的现代信息系统,其中隐私风险与数据删除需求日益突出。

原文摘要 · Abstract (English)

Machine unlearning is the process of removing the imprint left by specific data samples during the training of a machine learning model. AI developers, including those building personalized technologies, employ machine unlearning for various purposes such as privacy protection, security, and to address ethical concerns. This paper introduces Ready2Unlearn, a learning-time optimization approach designed to facilitate future unlearning processes. Unlike the majority of existing unlearning efforts that focus on designing unlearning algorithms, which are typically implemented reactively when an unlearning request is made during the model deployment phase, Ready2Unlearn shifts the focus to the training phase, adopting a "forward-looking" perspective. Building upon well-established meta-learning principles, Ready2Unlearn proactively trains machine learning models with unlearning readiness, such that they are well prepared and can handle future unlearning requests in a more efficient and principled manner. Ready2Unlearn is model-agnostic and compatible with any gradient ascent-based machine unlearning algorithms. We evaluate the method on both language and vision tasks under various unlearning settings, including class-wise unlearning and random data unlearning. Experimental results show that by incorporating such preparedness at training time, Ready2Unlearn produces an unlearning-ready model state, which offers several key advantages when future unlearning is requested. We hope this study inspires future research on proactive strategies for equipping machine learning models with built-in unlearning readiness, particularly in modern information systems that rely heavily on user data for recommendation, search, and personalized services, where privacy risks and data deletion demands are increasingly prevalent.

机器遗忘隐私保护模型训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。