针对特定属性设计更灵活的隐私保护机制,提升模型实用性和隐私保障。
Machine Learning with Privacy for Protected Attributes
- 提出特征差分隐私(FDP),可选择性保护部分敏感属性。
- 在动物人脸数据上训练扩散模型,隐私下图像质量提升约65%(FID从286.7降至101.9)。
- 适合需保护特定属性但保留其他特征的机器学习场景,如医疗或金融建模。
差分隐私(DP)已成为隐私数据分析的标准。某些机器学习应用仅需对特定受保护属性进行隐私保护。若在这些场景中使用传统的差分隐私变体,可能导致性能不必要的下降。本文提出一种更通用、更灵活的隐私框架——特征差分隐私(FDP),其基于模拟定义,支持添加/移除和替换两种隐私范式,并能处理任意且自适应的受保护与非受保护特征分离。我们证明了FDP具备自适应组合等性质,并展示了其在限制属性推断攻击中的作用。同时,我们改进了标准的DP-SGD算法,使其满足FDP,同时保留子采样带来的放大效应等优点。我们在多种机器学习任务中应用该框架,结果表明当公开特征可用时,可显著提升差分隐私训练模型的实用性。例如,在AFHQ动物人脸数据集上训练扩散模型,当ε=8时,相比传统DP方法,FID得分从286.7降至101.9,假设训练图像的模糊版本可作为公共特征。总体而言,本工作为私有数据分析提供了新思路,在保持强隐私保障的同时有效降低实用代价。
原文摘要 · Abstract (English)
Differential privacy (DP) has become the standard for private data analysis. Certain machine learning applications only require privacy protection for specific protected attributes. Using naive variants of differential privacy in such use cases can result in unnecessary degradation of utility. In this work, we refine the definition of DP to create a more general and flexible framework that we call feature differential privacy (FDP). Our definition is simulation-based and allows for both addition/removal and replacement variants of privacy, and can handle arbitrary and adaptive separation of protected and non-protected features. We prove the properties of FDP, such as adaptive composition, and demonstrate its implications for limiting attribute inference attacks. We also propose a modification of the standard DP-SGD algorithm that satisfies FDP while leveraging desirable properties such as amplification via sub-sampling. We apply our framework to various machine learning tasks and show that it can significantly improve the utility of DP-trained models when public features are available. For example, we train diffusion models on the AFHQ dataset of animal faces and observe a drastic improvement in FID compared to DP, from 286.7 to 101.9 at $ε=8$, assuming that the blurred version of a training image is available as a public feature. Overall, our work provides a new approach to private data analysis that can help reduce the utility cost of DP while still providing strong privacy guarantees.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。