arXiv:2510.08541math.STcs.DS2025-10被引 2

证明了谱算法在非均匀噪声下对低秩信号的计算最优性。

Computational and statistical lower bounds for low-rank estimation under general inhomogeneous noise

  • 提出新方法分析矩阵图和,突破传统块结构假设。
  • 证明当谱算法失效时,任意低次多项式算法也无效。
  • 适用于一般噪声方差分布,适合理论研究者阅读。

近期工作将经典尖峰威格纳矩阵模型(低秩信号+独立同分布高斯噪声)推广至非均匀噪声情形,即噪声具有方差轮廓。对于方差轮廓具块结构的特殊情况,已有研究识别出有效的谱算法、确定了算法成功的阈值信号强度,并在部分信号分布下证明了信息论下界与该阈值一致。本文补充研究该谱算法的计算最优性:我们证明,对更广泛的信号分布,只要谱算法无法检测低秩信号,则任何低次多项式算法也无法做到。这为Guionnet, Ko, Krzakala, Zdeborová(2023)提出的计算难解性猜想提供了首个证据。借助类似技术,我们还为一类先前未被处理的信号分布建立了精确的信息论下界。与以往结果不同,我们的结论不依赖于方差轮廓的块结构假设,暗示该谱算法可能对一般轮廓仍是最优的。我们通过数值实验验证了这一推测,针对一个平滑变化而非分段常数的轮廓示例。证明过程涉及矩阵图和的分析,其形式也出现在自由概率与交通概率中,但我们需要比现有结果更紧的新界,这些新界对非负矩阵而言可能具有独立价值。

原文摘要 · Abstract (English)

Recent work has generalized several results concerning the well-understood spiked Wigner matrix model of a low-rank signal matrix corrupted by additive i.i.d. Gaussian noise to the inhomogeneous case, where the noise has a variance profile. In particular, for the special case where the variance profile has a block structure, a series of results identified an effective spectral algorithm for detecting and estimating the signal, identified the threshold signal strength required for that algorithm to succeed, and proved information-theoretic lower bounds that, for some special signal distributions, match the above threshold. We complement these results by studying the computational optimality of this spectral algorithm. Namely, we show that, for a much broader range of signal distributions, whenever the spectral algorithm cannot detect a low-rank signal, then neither can any low-degree polynomial algorithm. This gives the first evidence for a computational hardness conjecture of Guionnet, Ko, Krzakala, and Zdeborová (2023). With similar techniques, we also prove sharp information-theoretic lower bounds for a class of signal distributions not treated by prior work. Unlike all of the above results on inhomogeneous models, our results do not assume that the variance profile has a block structure, and suggest that the same spectral algorithm might remain optimal for quite general profiles. We include a numerical study of this claim for an example of a smoothly-varying rather than piecewise-constant profile. Our proofs involve analyzing the graph sums of a matrix, which also appear in free and traffic probability, but we require new bounds on these quantities that are tighter than existing ones for non-negative matrices, which may be of independent interest.

低秩估计计算下界谱算法信息论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。