在差分隐私下,针对三类高维协方差矩阵设计了最优估计方法。
Minimax and Adaptive Covariance Matrix Estimation under Differential Privacy
- 针对不同结构设计了中心-外层二分估计器和分块三对角估计器。
- 发现隐私约束使维度呈多项式依赖,且不同类间可区分。
- 首次实现自适应估计,仅损失对数因子,适合隐私敏感场景。
协方差矩阵估计是众多统计应用的基础。本文研究在 $ρ$-零集中差分隐私($ρ$-zCDP)下,针对三类嵌套的高维协方差矩阵:点衰减类 $\mathcal{H}_α$、行尾类 $\mathcal{G}_α$ 与分离块类 $\mathcal{F}_α$,在平方算子范数损失与归一化平方Frobenius范数损失下的极小极大与自适应估计。针对 $\mathcal{H}_α$ 与 $\mathcal{G}_α$,提出适配其几何结构的中心-外层二分估计器;针对 $\mathcal{F}_α$,构造分块三对角估计器。所得极小极大率揭示了光滑度 $α$、损失形式、协方差类几何结构与隐私约束之间的非平凡交互。与非隐私情形不同,隐私可区分具有相同主导非私有率的协方差类,并引入维度的多项式依赖。进一步构建在三类协方差模型下对未知衰减参数 $α$ 的自适应估计程序,代价仅为多对数因子。为建立极小极大下界,发展了一种新颖的差分隐私 van Trees 不等式,将Fisher信息与 $ρ$-zCDP 约束关联,或可用于其他隐私估计问题。同时构造精巧先验分布以获得匹配的极小极大下界。
原文摘要 · Abstract (English)
Estimating covariance matrices is fundamental to a wide range of statistical applications. This paper studies minimax and adaptive estimation of high-dimensional covariance matrices under $ρ$-zero-concentrated differential privacy ($ρ$-zCDP) over three nested classes: the pointwise-decay class $\mathcal{H}_α$, the row-tail class $\mathcal{G}_α$, and the separated-block class $\mathcal{F}_α$. We consider both squared operator norm loss and normalized squared Frobenius norm loss. For $\mathcal{H}_α$ and $\mathcal{G}_α$, we develop center--outer dyadic estimators tailored to the refined geometry of the two classes, while for $\mathcal{F}_α$, we develop a blockwise tridiagonal estimator. The resulting minimax-optimal rates reveal a nontrivial interplay among the smoothness $α$, the loss, the geometry of the covariance class, and the privacy constraint. In contrast to the non-private setting, privacy distinguishes covariance classes that share the same leading non-private rate and induces a polynomial dependence on the ambient dimension. We further develop procedures that adapt to the unknown decay parameter over all three covariance classes under both losses, at the cost of at most polylogarithmic factors. To establish minimax lower bounds, we develop a novel differentially private van Trees inequality that connects Fisher information with the $ρ$-zCDP constraint and may be useful for other private estimation problems. We also construct carefully designed prior distributions to obtain matching minimax lower bounds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。