在去中心化场景下,用相关噪声协作生成隐私保护的合成数据。
Differentially Private Decentralized Dataset Synthesis Through Randomized Mixing with Correlated Noise
- 通过关联噪声协作,降低联邦学习中隐私保护带来的数据失真
- 在MNIST和FashionMNIST上实现与集中式相当的生成质量
- 适合关注隐私与数据效用平衡的研究者或工业应用
本文研究去中心化数据环境下差分隐私合成数据生成问题,基于近期提出的差分隐私类中心数据聚合(DP-CDA)方法。该方法在集中式设置中通过随机选取同类别样本进行混合并注入精确校准的高斯噪声,实现(ε, δ)-差分隐私。但在联邦设置中,各客户端仅持有少量数据,局部计算敏感度升高,需注入更多噪声以维持隐私保障,导致性能显著下降。为此,本文将相关性辅助隐私估计(CAPE)协议引入联邦DP-CDA框架,提出CAPE辅助联邦DP-CDA算法。该方法允许客户端生成联合分布的反向相关噪声,在聚合时相互抵消,同时保持个体隐私。实验在MNIST和FashionMNIST数据集上验证,该方法在特定参数下可实现与集中式版本相当的生成效用,且满足严格的差分隐私要求。
原文摘要 · Abstract (English)
In this work, we explore differentially private synthetic data generation in a decentralized-data setting by building on the recently proposed Differentially Private Class-Centric Data Aggregation (DP-CDA). DP-CDA synthesizes data in a centralized setting by mixing multiple randomly-selected samples from the same class and injecting carefully calibrated Gaussian noise, ensuring (ε, δ)-differential privacy. When deployed in a decentralized or federated setting, where each client holds only a small partition of the data, DP-CDA faces new challenges. The limited sample size per client increases the sensitivity of local computations, requiring higher noise injection to maintain the differential privacy guarantee. This, in turn, leads to a noticeable degradation in the utility compared to the centralized setting. To mitigate this issue, we integrate the Correlation-Assisted Private Estimation (CAPE) protocol into the federated DP-CDA framework and propose CAPE Assisted Federated DP-CDA algorithm. CAPE enables limited collaboration among the clients by allowing them to generate jointly distributed (anti-correlated) noise that cancels out in aggregate, while preserving privacy at the individual level. This technique significantly improves the privacy-utility trade-off in the federated setting. Extensive experiments on MNIST and FashionMNIST datasets demonstrate that the proposed CAPE Assisted Federated DP-CDA approach can achieve utility comparable to its centralized counterpart under some parameter regime, while maintaining rigorous differential privacy guarantees.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。