arXiv:2604.16075math.NAcs.DS2026-04被引 1

提出新算法,让线性方程求解器在任意条件数下都快速收敛到后向误差目标。

Towards Universal Convergence of Backward Error in Linear System Solvers

论文配图:Towards Universal Convergence of Backward Error in Linear System Solvers
图 1 · 摘自论文原文
  • 用经典里奇森迭代实现与条件数无关的后向误差收敛
  • 在正定系统上达到$O(n^2/ε)$复杂度,比传统方法更稳定
  • 扩展至一般线性系统,适合对精度要求高且条件差的场景

长期以来,如何在$O(n^2)$时间复杂度内求解$n\times n$线性系统,或以$O(n^2 \text{poly}(1/ε))$求解至$ε$相对误差,是数值线性代数与理论计算机科学中的开放难题。以往研究多基于前向误差衡量收敛性,受输入条件数影响大。而数值分析更推崇后向误差。本文发现:经典里奇森迭代在任意正半定(PSD)系统上,经过$k$次迭代后,后向误差最多为$1/k$,与条件数无关。这带来$O(n^2/ε)$复杂度的求解算法;采用多种克雷洛夫(Krylov)方法可得类似或更好性能。通过直接在克雷洛夫子空间最小化后向误差,进一步实现$O(1/k^2)$的通用收敛率,并设计出高效算法MINBERR,复杂度为$O(n^2/\sqrtε)$。最后,借助正规方程,将该方法推广至一般线性系统,复杂度为$O(n^2\log n/ε)$。在基准问题上验证了算法的强数值表现。

原文摘要 · Abstract (English)

The quest for an algorithm that solves an $n\times n$ linear system in $O(n^2)$ time complexity, or $O(n^2 \text{poly}(1/ε))$ when solving up to $ε$ relative error, is a long-standing open problem in numerical linear algebra and theoretical computer science. There are two predominant paradigms for measuring relative error: forward error (i.e., distance from the output to the optimum solution) and backward error (i.e., distance to the nearest problem solved by the output). In most prior studies, convergence of iterative linear system solvers is measured via various notions of forward error, and as a result, depends heavily on the conditioning of the input. Yet, the numerical analysis literature has long advocated for backward error as the more practically relevant notion of approximation. In this work, we show that -- surprisingly -- the classical and simple Richardson iteration incurs at most $1/k$ (relative) backward error after $k$ iterations on any positive semidefinite (PSD) linear system, irrespective of its condition number. This universal convergence rate implies an $O(n^2/ε)$ complexity algorithm for solving a PSD linear system to $ε$ backward error, and we establish similar or better complexity when using a variety of Krylov solvers beyond Richardson. Then, by directly minimizing backward error over a Krylov subspace, we attain an even faster $O(1/k^2)$ universal rate, and we turn this into an efficient algorithm, MINBERR, with complexity $O(n^2/\sqrtε)$. Finally, we extend this approach via normal equations to solving general linear systems in $O(n^2\log(n)/ε)$ time complexity. We report strong numerical performance of our algorithms on benchmark problems.

线性求解后向误差克雷洛夫方法算法复杂度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。