让图像修复模型自动遗忘特定敏感数据,保护隐私且不影响其他功能。
Accurate Forgetting for All-in-One Image Restoration Model
- 用对抗样本和梯度上升实现按实例遗忘,无需重新训练。
- 在两个主流统一修复模型上验证,遗忘特定退化类型后仍保持性能稳定。
- 适合关注模型隐私保护的图像修复研究者与应用开发者。
隐私保护始终是人工智能领域的关键议题。当前一种低成本方案称为机器遗忘,可在不重新训练模型的前提下消除模型中对私有数据的记忆。本文将该思想引入图像修复领域,针对全功能图像修复模型(可处理多种退化类型,如雾霾、雨滴)中某类数据(如雾霾数据)被视为私有时,提出需从已训练模型中移除其影响。这一任务面临巨大挑战:既要彻底消除敏感数据的影响,又需保证模型整体性能不受损,犹如在无特定乐器的情况下仍能演奏出和谐乐章。为此,本文提出一种简单而有效的方法——基于对抗样本与梯度上升的实例级遗忘。相比从头训练,该方法成本极低,能有效遗忘指定退化类型,同时保持对抗样本训练后的模型鲁棒性。在两个主流统一图像修复模型上的大量实验表明,该方法能在保留其余知识的同时,成功实现对特定退化类型的遗忘。
原文摘要 · Abstract (English)
Privacy protection has always been an ongoing topic, especially for AI. Currently, a low-cost scheme called Machine Unlearning forgets the private data remembered in the model. Specifically, given a private dataset and a trained neural network, we need to use e.g. pruning, fine-tuning, and gradient ascent to remove the influence of the private dataset on the neural network. Inspired by this, we try to use this concept to bridge the gap between the fields of image restoration and security, creating a new research idea. We propose the scene for the All-In-One model (a neural network that restores a wide range of degraded information), where a given dataset such as haze, or rain, is private and needs to be eliminated from the influence of it on the trained model. Notably, we find great challenges in this task to remove the influence of sensitive data while ensuring that the overall model performance remains robust, which is akin to directing a symphony orchestra without specific instruments while keeping the playing soothing. Here we explore a simple but effective approach: Instance-wise Unlearning through the use of adversarial examples and gradient ascent techniques. Our approach is a low-cost solution compared to the strategy of retraining the model from scratch, where the gradient ascent trick forgets the specified data and the performance of the adversarial sample maintenance model is robust. Through extensive experimentation on two popular unified image restoration models, we show that our approach effectively preserves knowledge of remaining data while unlearning a given degradation type.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。