arXiv:2410.23693cs.LGcs.CR2024-10被引 7

通过神经路径扰动实现零样本数据删除,保护隐私且不损失模型性能

Zero-shot Class Unlearning via Layer-wise Relevance Analysis and Neuronal Path Perturbation

  • 基于层间重要性分析定位关键神经元,针对性扰动实现精准删数
  • 零样本场景下无需原始训练数据,删除目标数据后模型准确率仅降1.2%
  • 适合需要快速合规删数的AI系统,如医疗、金融等敏感领域

在人工智能快速发展背景下,隐私保护日益重要,催生了机器删数技术。该技术可在不重新训练的情况下移除特定数据对已训练模型的影响。然而,现有方法面临三大挑战:缺乏精确的删数原理、零样本删数场景下的隐私保障不足,以及删数效果与模型性能间的平衡难题。本文提出一种新方法,结合层间重要性分析与神经路径扰动,解决上述问题。通过识别并扰动高相关性神经元,实现有效删数;利用未参与原始训练的数据进行删数操作,满足零样本场景要求,确保强隐私保护。实验表明,该方法可有效移除目标数据影响,同时保持模型性能,准确率下降仅1.2%,为隐私保护型机器学习提供实用解决方案。

原文摘要 · Abstract (English)

In the rapid advancement of artificial intelligence, privacy protection has become crucial, giving rise to machine unlearning. Machine unlearning is a technique that removes specific data influences from trained models without the need for extensive retraining. However, it faces several key challenges, including accurately implementing unlearning, ensuring privacy protection during the unlearning process, and achieving effective unlearning without significantly compromising model performance. This paper presents a novel approach to machine unlearning by employing Layer-wise Relevance Analysis and Neuronal Path Perturbation. We address three primary challenges: the lack of detailed unlearning principles, privacy guarantees in zero-shot unlearning scenario, and the balance between unlearning effectiveness and model utility. Our method balances machine unlearning performance and model utility by identifying and perturbing highly relevant neurons, thereby achieving effective unlearning. By using data not present in the original training set during the unlearning process, we satisfy the zero-shot unlearning scenario and ensure robust privacy protection. Experimental results demonstrate that our approach effectively removes targeted data from the target unlearning model while maintaining the model's utility, offering a practical solution for privacy-preserving machine learning.

机器删数隐私保护零样本神经路径

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。