arXiv:2606.20082math.OCcs.DS2026-06

突破传统平均法,实现约翰椭球高精度计算的高效算法

Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model

  • 改用最后迭代点替代平均点作为验证依据,提升算法效率
  • 精度依赖变为双对数级,显著降低查询次数
  • 适合追求高精度优化与理论分析的研究者

对称多面体 $P=\{\mathbf{x}\in\mathbb{R}^d:\|\mathbf{A}\mathbf{x}\|_\infty\le1\}$ 的约翰椭球计算长期依赖勒维特得分算法,以往方法在 $Θ(\varepsilon^{-1}\log(n/d))$ 次迭代内达到 $(1+\varepsilon)$-近似。本文将复杂度拆分为认证、识别与精度三部分,发现 $\varepsilon^{-1}$ 仅源于认证环节。在等价的 D-最优设计问题 $\min_{\mathbf{p}\inΔ_n}-\log\det(\sum_i p_i\mathbf{a}_i\mathbf{a}_i^\top)$ 中,勒维特得分即一阶梯度信息,$(1+\varepsilon)$ 近似对应 Frank-Wolfe 间隙 $g(\mathbf{p})\le\varepsilon d$。通过此视角,各成本可分离:使用最后迭代点而非平均点时,热启动加速方法仅需 $C(\mathbf{A})+O(\sqrtκ\log(1/\varepsilon))$ 次查询即可满足目标;一旦识别出最优面,该子问题为无约束自协调最小化,其海森矩阵可被精确恢复,阻尼牛顿法仅需 $O(\log\log(1/\varepsilon))$ 步,总查询量为 $C(\mathbf{A})+O(d^2\log\log(1/\varepsilon))$。因此精度依赖为双重对数,核心挑战转向识别成本与下界研究。

原文摘要 · Abstract (English)

The John ellipsoid of a symmetric polytope $P=\{\mathbf{x}\in\mathbb{R}^d:\|\mathbf{A}\mathbf{x}\|_\infty\le1\}$, $\mathbf{A}\in\mathbb{R}^{n\times d}$, is computed by a long line of leverage-score algorithms, from Cohen, Cousins, Lee and Yang (COLT 2019) to its successors [WY24, CLS+25], all reaching a $(1+\varepsilon)$-approximation in $Θ(\varepsilon^{-1}\log(n/d))$ iterations. We separate this complexity into three costs the modern line conflates (certification, identification, and accuracy) and locate the historical $\varepsilon^{-1}$ in the first alone. In the equivalent D-optimal-design form $\min_{\mathbf{p}\inΔ_n}-\log\det(\sum_i p_i\mathbf{a}_i\mathbf{a}_i^\top)$, the leverage-score oracle is exactly the first-order oracle and the $(1+\varepsilon)$-John guarantee the Frank-Wolfe gap $g(\mathbf{p})\le\varepsilon d$; through this dictionary the costs come apart. The $\varepsilon^{-1}$ is a certification artifact: the uniform average of the iterates, the certificate used throughout the line, has gap exactly $Θ(1/T)$, however cheap each iteration is made. Pointed instead at the last iterate the same oracle is fast: a warm-started accelerated method reaches the guarantee in $C(\mathbf{A})+O(\sqrtκ\log(1/\varepsilon))$ queries after an $\varepsilon$-independent setup $C(\mathbf{A})$, and once the optimal face is identified the facial problem is an unconstrained self-concordant minimization whose Hessian the oracle recovers exactly, so damped Newton needs only $O(\log\log(1/\varepsilon))$ steps, for a total of $C(\mathbf{A})+O(d^2\log\log(1/\varepsilon))$ queries. The accuracy dependence is thus doubly logarithmic after an $\varepsilon$-independent, condition-dependent setup; the open problem is the remaining identification cost (a condition-free bound on reaching the optimal face) and lower bounds. Accuracy is not the obstruction.

优化算法约翰椭球自协调优化高精度计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。