arXiv:2504.02199cs.CVcs.AI2025-04CVPR被引 8

提出可彻底删除模型中个人知识的新方法,防止信息泄露。

ESC: Erasing Space Concept for Knowledge Deletion

  • 通过消除特征空间中的关键激活实现无需训练的知识擦除
  • 在多个数据集和模型上实现最快且领先的遗忘效果
  • 适用于人脸等复杂场景,适合关注隐私保护的研究者

随着深度学习中的隐私担忧持续上升,用户越来越担心其个人知识被训练好的模型滥用。尽管已有多种研究尝试解决此问题,但往往忽视了用户对完全知识删除的真实需求。此外,我们发现现有方法可能通过嵌入特征泄露个人知识。为此,我们提出一种新任务——知识删除(KD),综合考虑上述问题,并引入知识保留分数(KR)作为评估特征空间中知识保留程度的指标。为此,我们提出一种无需训练的擦除方法:擦除空间概念(ESC),通过消除特征中与遗忘知识相关的激活来限制重要子空间。此外,我们还提出带训练的版本ESC-T,使用可学习掩码更好地平衡遗忘与知识保留之间的权衡。大量实验表明,所提方法在多种数据集和模型上均达到最快且最先进的性能。特别地,该方法在人脸域等场景中表现良好,展现出良好的泛化能力。代码已公开于http://github.com/KU-VGI/ESC。

原文摘要 · Abstract (English)

As concerns regarding privacy in deep learning continue to grow, individuals are increasingly apprehensive about the potential exploitation of their personal knowledge in trained models. Despite several research efforts to address this, they often fail to consider the real-world demand from users for complete knowledge erasure. Furthermore, our investigation reveals that existing methods have a risk of leaking personal knowledge through embedding features. To address these issues, we introduce a novel concept of Knowledge Deletion (KD), an advanced task that considers both concerns, and provides an appropriate metric, named Knowledge Retention score (KR), for assessing knowledge retention in feature space. To achieve this, we propose a novel training-free erasing approach named Erasing Space Concept (ESC), which restricts the important subspace for the forgetting knowledge by eliminating the relevant activations in the feature. In addition, we suggest ESC with Training (ESC-T), which uses a learnable mask to better balance the trade-off between forgetting and preserving knowledge in KD. Our extensive experiments on various datasets and models demonstrate that our proposed methods achieve the fastest and state-of-the-art performance. Notably, our methods are applicable to diverse forgetting scenarios, such as facial domain setting, demonstrating the generalizability of our methods. The code is available at http://github.com/KU-VGI/ESC .

知识删除隐私保护特征擦除

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。