用文字提示让GAN忘记特定内容,无需重新训练。
Prompting Forgetting: Unlearning in GANs via Textual Guidance
- 通过文本提示引导GAN无监督地删除特定特征或身份信息。
- 支持人脸表情、多属性等细粒度内容移除,效果优于传统方法。
- 无需额外数据或微调,适合需要快速合规的AI服务场景。
当前先进的生成模型具备强大的图像生成能力,给托管这些模型的服务提供商带来了诸多伦理与法律挑战。为此,内容移除技术(CRTs)成为研究热点,旨在不进行全量重训练的情况下控制输出。现有研究多聚焦于扩散模型的机器遗忘,而生成对抗网络(GANs)中的遗忘机制仍鲜有探索。本文提出Text-to-Unlearn框架,仅使用文本提示即可从预训练GAN中选择性地移除概念,实现特征遗忘、身份遗忘以及表情和多属性等细粒度任务的遗忘。该方法利用自然语言描述引导遗忘过程,无需额外数据集或监督微调,具备可扩展性和高效性。为评估有效性,我们引入一种基于先进图像-文本对齐指标的自动化遗忘评估方法,全面分析遗忘效果。据我们所知,Text-to-Unlearn是首个针对GAN的跨模态遗忘框架,代表了生成模型行为管理的一项灵活高效进展。
原文摘要 · Abstract (English)
State-of-the-art generative models exhibit powerful image-generation capabilities, introducing various ethical and legal challenges to service providers hosting these models. Consequently, Content Removal Techniques (CRTs) have emerged as a growing area of research to control outputs without full-scale retraining. Recent work has explored the use of Machine Unlearning in generative models to address content removal. However, the focus of such research has been on diffusion models, and unlearning in Generative Adversarial Networks (GANs) has remained largely unexplored. We address this gap by proposing Text-to-Unlearn, a novel framework that selectively unlearns concepts from pre-trained GANs using only text prompts, enabling feature unlearning, identity unlearning, and fine-grained tasks like expression and multi-attribute removal in models trained on human faces. Leveraging natural language descriptions, our approach guides the unlearning process without requiring additional datasets or supervised fine-tuning, offering a scalable and efficient solution. To evaluate its effectiveness, we introduce an automatic unlearning assessment method adapted from state-of-the-art image-text alignment metrics, providing a comprehensive analysis of the unlearning methodology. To our knowledge, Text-to-Unlearn is the first cross-modal unlearning framework for GANs, representing a flexible and efficient advancement in managing generative model behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。