arXiv:2604.07372stat.MLcs.IT2026-04被引 2

提出NS-RGS方法,用迭代替代SVD加速正交群同步计算

NS-RGS: Newton-Schulz based Riemannian gradient method for orthogonal group synchronization

  • 用Newton-Schulz迭代替代SVD/QR,降低每轮计算开销
  • 在合成数据与真实全球对齐任务中达最优精度,速度提升近2倍
  • 适合大规模正交群同步问题,尤其适合GPU/TPU加速场景

群同步是恢复群元素的经典任务,涉及从成对测量中重建。对于正交群同步,传统方法将其转化为带约束的非凸优化问题,并采用基于投影的方法(如广义幂法)求解。然而,这些方法每轮需精确计算SVD或QR分解,计算成本高,成为大规模问题的瓶颈。本文提出基于Newton-Schulz的黎曼梯度方案(NS-RGS),通过用Newton-Schulz迭代替代SVD/QR步骤,显著降低计算开销,且更契合现代GPU/TPU架构的高效矩阵乘法。借助改进的留一分析,克服统计依赖性难题,证明了在谱初始化下NS-RGS可线性收敛至目标解,达到近乎最优的统计噪声水平。在合成数据和真实世界全局对齐任务上的实验表明,NS-RGS性能媲美最先进方法(如广义幂法),同时实现近2倍的速度提升。

原文摘要 · Abstract (English)

Group synchronization is a fundamental task involving the recovery of group elements from pairwise measurements. For orthogonal group synchronization, the most common approach reformulates the problem as a constrained nonconvex optimization and solves it using projection-based methods, such as the generalized power method. However, these methods rely on exact SVD or QR decompositions in each iteration, which are computationally expensive and become a bottleneck for large-scale problems. In this paper, we propose a Newton-Schulz-based Riemannian Gradient Scheme (NS-RGS) for orthogonal group synchronization that significantly reduces computational cost by replacing the SVD or QR step with the Newton-Schulz iteration. This approach leverages efficient matrix multiplications and aligns perfectly with modern GPU/TPU architectures. By employing a refined leave-one-out analysis, we overcome the challenge arising from statistical dependencies, and establish that NS-RGS with spectral initialization achieves linear convergence to the target solution up to near-optimal statistical noise levels. Experiments on synthetic data and real-world global alignment tasks demonstrate that NS-RGS attains accuracy comparable to state-of-the-art methods such as the generalized power method, while achieving nearly a 2$\times$ speedup.

群同步黎曼优化矩阵迭代加速计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。