让视觉Transformer selectively遗忘数据,既合规又不伤性能。
LetheViT: Selective Machine Unlearning for Vision Transformers via Attention-Guided Contrastive Learning
- 用注意力引导的对比学习,区分要忘和要留的信息。
- 在相同类别中随机删样本,仍保持90%以上识别准确率。
- 适合需要合规删除用户数据的AI系统开发者。
视觉变换器(ViTs)在计算机视觉任务中表现卓越,但隐私法规如GDPR和CCPA要求用户可撤回数据,不仅需删除数据,还需彻底消除其对模型的影响。机器遗忘成为关键解决方案,精确遗忘计算成本过高,近似方法更具实用性。本文针对ViTs中的随机数据遗忘场景——即在同类别中删除特定样本而保留其余数据——提出新方法LetheViT。通过选择性掩码实验发现:遮蔽高注意力区域后,模型仍能识别,但记忆能力显著下降。基于此,我们设计了一种对比式遗忘机制:以掩码图像生成正样本logits,原图生成负样本logits,引导模型遗忘具体细节而保留类别整体特征。实验表明,LetheViT达到当前最优性能,在满足隐私合规的同时维持模型有效性。
原文摘要 · Abstract (English)
Vision Transformers (ViTs) have revolutionized computer vision tasks with their exceptional performance. However, the introduction of privacy regulations such as GDPR and CCPA has brought new challenges to them. These laws grant users the right to withdraw their data, necessitating not only the deletion of data but also the complete removal of its influence from trained models. Machine unlearning emerges as a critical solution, with exact unlearning being computationally prohibitive and approximate methods offering a more practical approach. This work addresses the particularly challenging scenario of random data forgetting in ViTs, where the model must forget specific samples while retaining others, even within the same class. We first reveal the core characteristics of ViTs through selective masking experiments: when high-attention areas are masked, the model retains its recognition capability but significantly weakens its memorization ability. Based on the above insights, we propose LetheViT, a contrastive unlearning method tailored for ViTs. LetheViT uses masked image inputs to generate positive logits and original image inputs to generate negative logits, guiding the model to forget specific details while retaining the general cl category outlines. Experimental results demonstrate that LetheViT achieves state-of-the-art performance, effectively balancing privacy compliance with model efficacy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。