arXiv:2502.07657cs.DScs.CR2025-02被引 9

用随机矩阵动力学方法,更精准地实现隐私保护下的低秩近似。

Private Low-Rank Approximation for Covariance Matrices, Dyson Brownian Motion, and Eigenvalue-Gap Bounds for Gaussian Perturbations

  • 将高斯噪声视为连续时间矩阵布朗运动,追踪特征值演化。
  • 在谱结构合理时,误差上界优于已有方法,关键依赖特征值间隙。
  • 适合研究隐私计算、随机矩阵理论及低秩分解的学者参考。

我们研究在 $(\varepsilon,δ)$-差分隐私约束下,对 $d \times d$ 协方差矩阵 $M$ 进行秩-$k$ 低秩近似的问题。提出并分析了一种复杂的高斯机制变体,给出了该机制输出矩阵与 $M$ 最优秩-$k$ 近似之间弗罗贝尼乌斯范数差的上界。分析表明,在 $M$ 的谱满足自然结构假设时,该上界优于先前结果。核心洞见是将矩阵加高斯噪声视为连续时间矩阵布朗运动,利用杜森(Dyson)发现的随机微分方程追踪特征值与特征向量的演化。由此可将误差表示为涉及随机演化矩阵逆特征值间隙的积分,而非传统戴维斯-卡汉型定理所得的扰动界之和。进一步基于此视角,证明了高斯扰动后矩阵的特征值具有大间隙的概率很高。这些成果也推进了平均情况扰动下的低秩近似分析,并深化了对随机矩阵特征值间隙的理解,具有独立研究价值。

原文摘要 · Abstract (English)

We consider the problem of approximating a $d \times d$ covariance matrix $M$ with a rank-$k$ matrix under $(\varepsilon,δ)$-differential privacy. We present and analyze a complex variant of the Gaussian mechanism and obtain upper bounds on the Frobenius norm of the difference between the matrix output by this mechanism and the best rank-$k$ approximation to $M$. Our analysis provides improvements over previous bounds, particularly when the spectrum of $M$ satisfies natural structural assumptions. The novel insight is to view the addition of Gaussian noise to a matrix as a continuous-time matrix Brownian motion. This viewpoint allows us to track the evolution of eigenvalues and eigenvectors of the matrix, which are governed by stochastic differential equations discovered by Dyson. These equations enable us to upper bound the Frobenius distance between the best rank-$k$ approximation of $M$ and that of a Gaussian perturbation of $M$ as an integral that involves inverse eigenvalue gaps of the stochastically evolving matrix, as opposed to a sum of perturbation bounds obtained via Davis-Kahan-type theorems. Subsequently, again using the Dyson Brownian motion viewpoint, we show that the eigenvalues of the matrix $M$ perturbed by Gaussian noise have large gaps with high probability. These results also contribute to the analysis of low-rank approximations under average-case perturbations, and to an understanding of eigenvalue gaps for random matrices, both of which may be of independent interest.

隐私计算低秩近似随机矩阵差分隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。