提出统一框架,解决生成模型删忆中的目标、方法与评估不一致问题。
Generative Model Unlearning: A Survey through Target Events, Unlearning Operators, and Evaluation Protocols
- 将删忆建模为针对目标事件的分布投影,统一方法论
- 首次系统关联隐私、版权、安全等应用场景
- 适合关注生成模型可信赖性的研究者与开发者
随着生成模型快速发展,隐私、版权、安全与可靠性风险日益凸显。为缓解这些问题,机器删忆从传统分类模型拓展至生成领域。然而现有研究在目标定义、删忆机制与评估协议上仍碎片化,难以跨模型、模态和应用客观比较。此外,多数模态特异性综述忽略了生成模型删忆的共性结构。为此,本文提出全面回顾,将生成模型删忆(GenMU)形式化为:给定目标事件,删忆算子对生成分布进行约束投影,抑制相关输出同时保留有用行为并控制算子开销。在此框架下,删忆请求由目标事件指定,通过删忆算子实现,并基于目标抑制、分布保持与算子成本进行实证评估。我们重新组织现有研究,并首次明确揭示其与主流应用(如隐私保护、版权与风格防护、安全对齐、幻觉缓解、部署防御)的联系。最后,指出现有关键挑战与未来方向,推动可靠、可扩展、鲁棒且可审计的生成模型删忆发展。开源资源持续维护于 https://github.com/caxLee/GenMU-Survey。
原文摘要 · Abstract (English)
With the rapid advancement of generative models, privacy, copyright, safety, and reliability risks have attracted growing attention. To mitigate these risks, machine unlearning has been increasingly adapted from traditional classification models to generative settings. Despite notable progress, existing studies remain fragmented in their target definitions, unlearning mechanisms, and evaluation protocols, making objective comparison difficult across models, modalities, and applications. Moreover, modality-specific surveys often overlook the shared structure of Generative Model Unlearning (GenMU). To address this gap, we provide a comprehensive review of GenMU and formulate it as target-constrained distributional projection: given a target event, an unlearning operator transforms the generative distribution to suppress target-related outputs while preserving useful behavior and controlling operator cost. Under this framework, an unlearning request is specified by a target event, implemented through an unlearning operator, and assessed by empirical evidence over target suppression, distribution preservation, and operator cost. We further reorganize existing GenMU studies under this view. From this perspective, we provide the first explicit and unified account of how GenMU connects to mainstream applications, including privacy protection, copyright and style protection, safety alignment, hallucination mitigation, and deployment defense. Finally, we identify key open problems and future directions toward reliable, scalable, robust, and auditable GenMU. We consistently maintain the related open-source materials at https://github.com/caxLee/GenMU-Survey.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。