提出联合估计协方差与精度矩阵的新方法,有效缓解样本估计的谱偏差问题。
SCOPE: Spectral Concentration by Distributionally Robust Joint Covariance-Precision Estimation
- 基于分布鲁棒优化,同时最小化协方差与精度矩阵的损失
- 新方法使估计器条件数显著改善,收缩效应提升稳定性
- 适合高维数据中需要稳健协方差估计的场景
我们提出一种分布鲁棒的联合协方差矩阵与精度矩阵估计方法。该模型在以名义分布为中心的模糊集内,最小化协方差估计器的Frobenius损失与精度矩阵估计器的Stein损失的加权最坏情况。模糊集半径通过凸谱散度度量。证明该模型可转化为凸优化问题,得到准解析解。联合估计器为非线性收缩形式,特征值被非线性地收缩至一个正标量,该标量由损失项权重决定。通过调节权重,可纠正经验协方差/精度矩阵的谱偏差。由此得名谱集中协方差与精度矩阵估计器(SCOPE)。理论表明收缩能改善估计器条件数,并给出渐近最优的参数调优方案。合成与真实数据实验显示,其性能优于现有先进方法。
原文摘要 · Abstract (English)
We propose a distributionally robust formulation for simultaneously estimating the covariance matrix and the precision matrix of a random vector.The proposed model minimizes the worst-case weighted sum of the Frobenius loss of the covariance estimator and Stein's loss of the precision matrix estimator against all distributions from an ambiguity set centered at the nominal distribution. The radius of the ambiguity set is measured via convex spectral divergence. We demonstrate that the proposed distributionally robust estimation model can be reduced to a convex optimization problem, thereby yielding quasi-analytical estimators. The joint estimators are shown to be nonlinear shrinkage estimators. The eigenvalues of the estimators are shrunk nonlinearly towards a positive scalar, where the scalar is determined by the weight coefficient of the loss terms. By tuning the coefficient carefully, the shrinkage corrects the spectral bias of the empirical covariance/precision matrix estimator. By this property, we call the proposed joint estimator the Spectral concentrated COvariance and Precision matrix Estimator (SCOPE). We demonstrate that the shrinkage effect improves the condition number of the estimator. We provide a parameter-tuning scheme that adjusts the shrinkage target and intensity that is asymptotically optimal. Numerical experiments on synthetic and real data show that our shrinkage estimators perform competitively against state-of-the-art estimators in practical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。