分布式隐私PCA方法,让多智能体在不共享原始数据下安全计算主成分。
Decentralized Differentially Private Power Method
- 各智能体仅观测部分维度,通过本地嵌入和噪声共享实现隐私保护协作。
- 在ε∈[2,5]的中等隐私强度下,隐私与性能权衡优于传统本地化隐私方法。
- 无需中心节点,适用于去中心化网络,适合注重数据隐私的分布式系统。
我们提出一种新型去中心化差分隐私幂法(D-DP-PM),用于在网络化多智能体环境中进行主成分分析(PCA)。与传统去中心化PCA不同,各智能体仅通过行划分观测数据的子集维度。该方法在不依赖中心聚合器的前提下,保证$(ε,δ)$-差分隐私,并实现全局特征向量的协同估计。通过仅共享当前特征向量迭代的本地嵌入,并结合随机初始化带来的内在隐私性与精心校准的高斯噪声添加,实现隐私保障。理论分析基于线性动力学与高维概率论,建立了紧致的隐私与效用边界,明确刻画了网络拓扑的影响。实验证明,相较于朴素本地差分隐私方法,D-DP-PM在真实数据集上实现了更优的隐私-效用权衡,尤其在中等隐私水平(ε∈[2,5])表现突出。算法收敛迅速,支持通过增加迭代次数换取更强隐私,同时保持良好实用性。
原文摘要 · Abstract (English)
We propose a novel Decentralized Differentially Private Power Method (D-DP-PM) for performing Principal Component Analysis (PCA) in networked multi-agent settings. Unlike conventional decentralized PCA approaches where each agent accesses the full n-dimensional sample space, we address the challenging scenario where each agent observes only a subset of dimensions through row-wise data partitioning. Our method ensures $(ε,δ)$-Differential Privacy (DP) while enabling collaborative estimation of global eigenvectors across the network without requiring a central aggregator. We achieve this by having agents share only local embeddings of the current eigenvector iterate, leveraging both the inherent privacy from random initialization and carefully calibrated Gaussian noise additions. We prove that our algorithm satisfies the prescribed $(ε,δ)$-DP guarantee and establish convergence rates that explicitly characterize the impact of the network topology. Our theoretical analysis, based on linear dynamics and high-dimensional probability theory, provides tight bounds on both privacy and utility. Experiments on real-world datasets demonstrate that D-DP-PM achieves superior privacy-utility tradeoffs compared to naive local DP approaches, with particularly strong performance in moderate privacy regimes ($ε\in[2, 5]$). The method converges rapidly, allowing practitioners to trade iterations for enhanced privacy while maintaining competitive utility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。