提出可评估生成模型选择性遗忘的基准数据集与评测方法。
ForgetMe: Evaluating Selective Forgetting in Generative Models
- 基于提示分层编辑与无训练局部特征移除构建数据集
- 引入纠缠度量,支持成对与非成对图像的无监督评估
- 在多个真实与合成数据集上验证了方法的有效性
扩散模型在图像生成中的广泛应用加剧了隐私合规性卸载的需求。然而,由于扩散模型具有高维特性与复杂特征表示,实现选择性卸载仍具挑战性,现有方法难以在移除敏感信息的同时保持非敏感区域的一致性。为此,我们提出一种基于提示的分层编辑与无训练局部特征移除的自动数据集构建框架,构建了ForgetMe数据集,并引入纠缠度量(Entangled metric)量化卸载效果。该度量通过评估目标区域与背景区域间的相似性与一致性,支持成对(Entangled-D)与非成对(Entangled-S)图像数据,实现无监督评估。ForgetMe数据集涵盖多种真实与合成场景,包括CUB-200-2011(Birds)、Stanford-Dogs、ImageNet及合成猫数据集。我们在Stable Diffusion上采用LoRA微调实现选择性卸载,并验证了ForgetMe数据集与纠缠度量的有效性,确立其为选择性卸载领域的基准。本工作为隐私保护生成式AI提供了可扩展且适应性强的解决方案。
原文摘要 · Abstract (English)
The widespread adoption of diffusion models in image generation has increased the demand for privacy-compliant unlearning. However, due to the high-dimensional nature and complex feature representations of diffusion models, achieving selective unlearning remains challenging, as existing methods struggle to remove sensitive information while preserving the consistency of non-sensitive regions. To address this, we propose an Automatic Dataset Creation Framework based on prompt-based layered editing and training-free local feature removal, constructing the ForgetMe dataset and introducing the Entangled evaluation metric. The Entangled metric quantifies unlearning effectiveness by assessing the similarity and consistency between the target and background regions and supports both paired (Entangled-D) and unpaired (Entangled-S) image data, enabling unsupervised evaluation. The ForgetMe dataset encompasses a diverse set of real and synthetic scenarios, including CUB-200-2011 (Birds), Stanford-Dogs, ImageNet, and a synthetic cat dataset. We apply LoRA fine-tuning on Stable Diffusion to achieve selective unlearning on this dataset and validate the effectiveness of both the ForgetMe dataset and the Entangled metric, establishing them as benchmarks for selective unlearning. Our work provides a scalable and adaptable solution for advancing privacy-preserving generative AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。