arXiv:2411.01974cond-mat.dis-nncs.IT2024-11被引 8

突破旋转不变性限制,揭示对称矩阵去噪的相变规律。

On the phase diagram of extensive-rank symmetric matrix denoising beyond rotational invariance

  • 提出多尺度平均场方法分析非旋转不变的高秩矩阵去噪
  • 发现去噪-因子分解相变点,决定能否恢复原始信号
  • 理论与数值吻合,适用于高维信号处理场景

矩阵去噪在信号处理和机器学习中至关重要。当待估计矩阵具有随维度增长的因子结构时,其统计分析长期面临挑战,尤其在缺乏旋转不变性的情况下。现有成果仅限于旋转不变情形,此时信息论极限及贝叶斯最优去噪算法(旋转不变估计器)已知。但该模型既非典型自旋系统,也非高能物理中的矩阵模型,而是两者的混合体。本文研究非旋转不变的因子矩阵 $XX^ op$ 的贝叶斯去噪问题。蒙特卡洛模拟表明存在一个‘去噪-因子分解相变’:相变前,旋转不变估计器仍为贝叶斯最优(源于随机矩阵理论的普适性);相变后,普适性破缺,更优去噪成为可能但算法上困难。我们论证只有越过相变点,才能以不可分辨的模糊性估计出 $X$ 本身。理论上,采用可解释的多尺度平均场方法,计算最小均方误差与互信息,结果与[3]的副本法一致。结合数值洞察,我们界定出平均场理论精确的相区,并在不成立时利用普适性修正。完整假设在考虑有限尺寸效应下,与数值结果高度吻合。

原文摘要 · Abstract (English)

Matrix denoising is central to signal processing and machine learning. Its statistical analysis when the matrix to infer has a factorised structure with a rank growing proportionally to its dimension remains a challenge, except when it is rotationally invariant. In this case the information theoretic limits and an efficient Bayes-optimal denoising algorithm, called rotational invariant estimator [1,2], are known. Beyond this setting few results can be found. The reason is that the model is not a usual spin system because of the growing rank dimension, nor a matrix model (as appearing in high-energy physics) due to the lack of rotation symmetry, but rather a hybrid between the two. Here we make progress towards the understanding of Bayesian matrix denoising when the signal is a factored matrix $XX^\intercal$ that is not rotationally invariant. Monte Carlo simulations suggest the existence of a \emph{denoising-factorisation transition} separating a phase where denoising using the rotational invariant estimator remains Bayes-optimal due to universality properties of the same nature as in random matrix theory, from one where universality breaks down and better denoising is possible, though algorithmically hard. We argue that it is only beyond the transition that factorisation, i.e., estimating $X$ itself, becomes possible up to irresolvable ambiguities. On the theory side, we combine mean-field techniques in an interpretable multiscale fashion in order to access the minimum mean-square error and mutual information. Interestingly, our alternative method yields equations reproducible by the replica approach of [3]. Using numerical insights, we delimit the portion of phase diagram where we conjecture the mean-field theory to be exact, and correct it using universality when it is not. Our complete ansatz matches well the numerics in the whole phase diagram when considering finite size effects.

矩阵去噪相变贝叶斯推断高维统计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。