arXiv:2507.15232stat.MEcs.LG2025-07

提出一种适用于重尾和含污染数据的差分隐私主成分分析方法。

Robust and Differentially Private Principal Component Analysis

  • 通过有界变换处理重尾数据,保持特征向量顺序不变。
  • 在非高斯或含污染数据中,主子空间恢复精度显著优于现有方法。
  • 无需假设数据分布,计算高效,适合实际数据分析场景。

近期研究推动了隐私保护主成分分析(PCA)的发展,但许多现有方法依赖于严格的假设,如假设数据服从次高斯分布,或对数据污染敏感,且部分方法计算复杂或依赖未知模型参数,限制了数据分析师的应用。本文提出一种适用于重尾及可能受污染数据的差分隐私PCA方法。该方法利用在椭球分布下经适当缩放后的数据协方差矩阵保持特征向量及其顺序的性质,涵盖高斯与重尾分布。通过施加有界变换,实现可差分隐私的主成分计算,并保障对数据污染的鲁棒性。我们进行了理论分析与实验评估,重点关注恢复主导主成分所张成子空间的能力。大量数值实验表明,该方法在统计效用上持续优于现有方法,尤其在非高斯或含污染数据设置下表现突出。

原文摘要 · Abstract (English)

Recent advances have sparked significant interest in the development of privacy-preserving Principal Component Analysis (PCA). However, many existing approaches rely on restrictive assumptions, such as assuming sub-Gaussian data or being vulnerable to data contamination. Additionally, some methods are computationally expensive or depend on unknown model parameters that must be estimated, limiting their accessibility for data analysts seeking privacy-preserving PCA. In this paper, we propose a differentially private PCA method applicable to heavy-tailed and potentially contaminated data. Our approach leverages the property that the covariance matrix of properly rescaled data preserves eigenvectors and their order under elliptical distributions, which include Gaussian and heavy-tailed distributions. By applying a bounded transformation, we enable straightforward computation of principal components in a differentially private manner. Additionally, boundedness guarantees robustness against data contamination. We conduct both theoretical analysis and empirical evaluations of the proposed method, focusing on its ability to recover the subspace spanned by the leading principal components. Extensive numerical experiments demonstrate that our method consistently outperforms existing approaches in terms of statistical utility, particularly in non-Gaussian or contaminated data settings.

差分隐私主成分分析鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。