arXiv:2603.28346cs.LGstat.ML2026-03

用神经网络改进矩阵估计,提速增准。

Machine Learning-Assisted High-Dimensional Matrix Estimation

  • 用可学习参数重写经典优化算法的迭代步骤
  • 理论证明新方法收敛更快,精度更高
  • 适合需要快速处理高维数据的研究者

高维矩阵(如协方差与精度矩阵)的高效估计是现代多元统计的核心问题。现有研究多关注估计器的理论性质(如一致性与稀疏性),却忽视了高维场景下的计算挑战。受基于学习的优化方法启发,本文将数据驱动结构与经典优化算法结合,提出机器学习辅助的高维矩阵估计方法。针对高维矩阵估计的优化问题,首先采用线性化交替方向乘子法(LADMM)求解;随后引入可学习参数,用神经网络建模迭代中的近端算子,从而提升估计精度并加速收敛。理论上,我们先证明LADMM的收敛性,再建立其重参数化版本的收敛性、收敛速率与单调性,并表明重参数化后方法具有更快的收敛速度。该理论与方法适用于高维协方差与精度矩阵的估计。通过在不同结构与维度的高维矩阵上对比多个经典优化算法,验证了所提方法的有效性。

原文摘要 · Abstract (English)

Efficient estimation of high-dimensional matrices-including covariance and precision matrices-is a cornerstone of modern multivariate statistics. Most existing studies have focused primarily on the theoretical properties of the estimators (e.g., consistency and sparsity), while largely overlooking the computational challenges inherent in high-dimensional settings. Motivated by recent advances in learning-based optimization method-which integrate data-driven structures with classical optimization algorithms-we explore high-dimensional matrix estimation assisted by machine learning. Specifically, for the optimization problem of high-dimensional matrix estimation, we first present a solution procedure based on the Linearized Alternating Direction Method of Multipliers (LADMM). We then introduce learnable parameters and model the proximal operators in the iterative scheme with neural networks, thereby improving estimation accuracy and accelerating convergence. Theoretically, we first prove the convergence of LADMM, and then establish the convergence, convergence rate, and monotonicity of its reparameterized counterpart; importantly, we show that the reparameterized LADMM enjoys a faster convergence rate. Notably, the proposed reparameterization theory and methodology are applicable to the estimation of both high-dimensional covariance and precision matrices. We validate the effectiveness of our method by comparing it with several classical optimization algorithms across different structures and dimensions of high-dimensional matrices.

矩阵估计机器学习优化算法高维统计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。