arXiv:2507.09711cs.DScs.LG2025-07被引 1

发现矩阵缩放算法在密度阈值0.5处存在性能突变,解释了其为何高效。

Phase transition of the Sinkhorn-Knopp algorithm

  • 以矩阵密度γ为参数,分析算法收敛速度
  • γ>1/2时仅需O(log n - log ε)轮迭代即接近双随机化
  • 首次揭示γ=1/2是理论收敛的临界点,适合优化研究者

矩阵缩放问题,尤其是Sinkhorn-Knopp算法,已研究超过60年。实践中该算法常在少数迭代内获得高质量近似,但理论上最佳上界属于伪多项式时间近似算法。下界研究仍不充分。核心问题在于:算法为何表现优异?能否建立紧致的迭代次数界?对n×n矩阵,其归一化版本定义为各元素除以其最大值。若归一化矩阵存在常数ρ>0,使得某行或列恰好有⌈γn⌉个值≥ρ的元素,且其余行列均至少有⌈γn⌉个,则称其密度为γ。对于上界,我们证明:当γ>1/2时,算法可在O(log n - log ε)次迭代和˜O(n²)时间内生成几乎双随机矩阵,适用于算法主要实践输入与典型理论场景,且˜O(n²)时间最优。对于下界,我们建立正矩阵在ℓ₂范数误差下的紧致下界˜Ω(n^{1/2}/ε)。此外,对任意γ<1/2,存在密度为γ的矩阵使算法需Ω(n^{1/2}/ε)次迭代。综上,我们的结果揭示了算法在密度阈值γ=1/2处的显著相变现象。

原文摘要 · Abstract (English)

The matrix scaling problem, particularly the Sinkhorn-Knopp algorithm, has been studied for over 60 years. In practice, the algorithm often yields high-quality approximations within just a few iterations. Theoretically, however, the best-known upper bound places it in the class of pseudopolynomial-time approximation algorithms. Meanwhile, the lower-bound landscape remains largely unexplored. Two fundamental questions persist: what accounts for the algorithm's strong empirical performance, and can a tight bound on its iteration count be established? For an $n\times n$ matrix, its normalized version is obtained by dividing each entry by its largest entry. We say that a normalized matrix has a density $γ$ if there exists a constant $ρ> 0$ such that one row or column has exactly $\lceil γn \rceil$ entries with values at least $ρ$, and every other row and column has at least $\lceil γn \rceil$ such entries. For the upper bound, we show that the Sinkhorn-Knopp algorithm produces a nearly doubly stochastic matrix in $O(\log n - \log \varepsilon)$ iterations and $\widetilde{O}(n^2)$ time for all nonnegative square matrices whose normalized version has a density $γ> 1/2$. Such matrices cover both the algorithm's principal practical inputs and its typical theoretical regime, and the $\widetilde{O}(n^2)$ runtime is optimal. For the lower bound, we establish a tight bound of $\widetildeΩ\left(n^{1/2}/\varepsilon\right)$ iterations for positive matrices under the $\ell_2$-norm error measure. Moreover, for every $γ< 1/2$, there exists a matrix with density $γ$ for which the algorithm requires $Ω\left(n^{1/2}/\varepsilon\right)$ iterations. In summary, our results reveal a sharp phase transition in the Sinkhorn-Knopp algorithm at the density threshold $γ= 1/2$.

矩阵缩放算法分析收敛性相变

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。