在训练时主动混淆敏感数据,让AI模型从不记住它。
Technical Report for the Forgotten-by-Design Project: Targeted Obfuscation for Machine Learning
- 训练时对敏感样本加噪并调整权重,防止其被模型学习
- 在CIFAR-10上使隐私风险降低一个数量级,准确率不变
- 适合关注数据隐私合规与可解释防御的开发者
隐私权在人工智能时代面临新挑战。本文探讨了人工智能系统中的“被遗忘的权利”(RTBF),对比传统数据删除方法。提出“设计即遗忘”(Forgotten by Design)方案,在模型训练阶段集成实例特定的混淆技术,主动阻止敏感数据被嵌入。不同于训练后修改模型的机器遗忘,本方法从源头预防。通过LIRA成员推断攻击识别脆弱数据点,提出结合加性梯度噪声与权重策略的防御机制。在CIFAR-10上的实验表明,该方法在95%置信水平下将隐私风险降低至少一个数量级,同时保持模型准确率。此外,还提供隐私-效用权衡的可视化工具,为平衡隐私风险与模型性能提供清晰框架。该工作推动符合人类动机性遗忘认知的隐私保护AI发展,为敏感信息防护和隐私法规遵从提供可靠方案。
原文摘要 · Abstract (English)
The right to privacy, enshrined in various human rights declarations, faces new challenges in the age of artificial intelligence (AI). This paper explores the concept of the Right to be Forgotten (RTBF) within AI systems, contrasting it with traditional data erasure methods. We introduce Forgotten by Design, a proactive approach to privacy preservation that integrates instance-specific obfuscation techniques during the AI model training process. Unlike machine unlearning, which modifies models post-training, our method prevents sensitive data from being embedded in the first place. Using the LIRA membership inference attack, we identify vulnerable data points and propose defenses that combine additive gradient noise and weighting schemes. Our experiments on the CIFAR-10 dataset demonstrate that our techniques reduce privacy risks by at least an order of magnitude while maintaining model accuracy (at 95% significance). Additionally, we present visualization methods for the privacy-utility trade-off, providing a clear framework for balancing privacy risk and model accuracy. This work contributes to the development of privacy-preserving AI systems that align with human cognitive processes of motivated forgetting, offering a robust framework for safeguarding sensitive information and ensuring compliance with privacy regulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。