突破传统平均法,实现约翰椭球高精度计算的高效算法
Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model
- 改用最后迭代点替代平均点作为验证依据,提升算法效率
- 精度依赖变为双对数级,显著降低查询次数
- 适合追求高精度优化与理论分析的研究者
对称多面体 $P=\{\mathbf{x}\in\mathbb{R}^d:\|\mathbf{A}\mathbf{x}\|_\infty\le1\}$ 的约翰椭球计算长期依赖勒维特得分算法,以往方法在 $Θ(\varepsilon^{-1}\log(n/d))$ 次迭代内达到 $(1+\varepsilon)$-近似。本文将复杂度拆分为认证、识别与精度三部分,发现 $\varepsilon^{-1}$ 仅源于认证环节。在等价的 D-最优设计问题 $\min_{\mathbf{p}\inΔ_n}-\log\det(\sum_i p_i\mathbf{a}_i\mathbf{a}_i^\top)$ 中,勒维特得分即一阶梯度信息,$(1+\varepsilon)$ 近似对应 Frank-Wolfe 间隙 $g(\mathbf{p})\le\varepsilon d$。通过此视角,各成本可分离:使用最后迭代点而非平均点时,热启动加速方法仅需 $C(\mathbf{A})+O(\sqrtκ\log(1/\varepsilon))$ 次查询即可满足目标;一旦识别出最优面,该子问题为无约束自协调最小化,其海森矩阵可被精确恢复,阻尼牛顿法仅需 $O(\log\log(1/\varepsilon))$ 步,总查询量为 $C(\mathbf{A})+O(d^2\log\log(1/\varepsilon))$。因此精度依赖为双重对数,核心挑战转向识别成本与下界研究。
原文摘要 · Abstract (English)
The John ellipsoid of a symmetric polytope $P=\{\mathbf{x}\in\mathbb{R}^d:\|\mathbf{A}\mathbf{x}\|_\infty\le1\}$, $\mathbf{A}\in\mathbb{R}^{n\times d}$, is computed by a long line of leverage-score algorithms, from Cohen, Cousins, Lee and Yang (COLT 2019) to its successors [WY24, CLS+25], all reaching a $(1+\varepsilon)$-approximation in $Θ(\varepsilon^{-1}\log(n/d))$ iterations. We separate this complexity into three costs the modern line conflates (certification, identification, and accuracy) and locate the historical $\varepsilon^{-1}$ in the first alone. In the equivalent D-optimal-design form $\min_{\mathbf{p}\inΔ_n}-\log\det(\sum_i p_i\mathbf{a}_i\mathbf{a}_i^\top)$, the leverage-score oracle is exactly the first-order oracle and the $(1+\varepsilon)$-John guarantee the Frank-Wolfe gap $g(\mathbf{p})\le\varepsilon d$; through this dictionary the costs come apart. The $\varepsilon^{-1}$ is a certification artifact: the uniform average of the iterates, the certificate used throughout the line, has gap exactly $Θ(1/T)$, however cheap each iteration is made. Pointed instead at the last iterate the same oracle is fast: a warm-started accelerated method reaches the guarantee in $C(\mathbf{A})+O(\sqrtκ\log(1/\varepsilon))$ queries after an $\varepsilon$-independent setup $C(\mathbf{A})$, and once the optimal face is identified the facial problem is an unconstrained self-concordant minimization whose Hessian the oracle recovers exactly, so damped Newton needs only $O(\log\log(1/\varepsilon))$ steps, for a total of $C(\mathbf{A})+O(d^2\log\log(1/\varepsilon))$ queries. The accuracy dependence is thus doubly logarithmic after an $\varepsilon$-independent, condition-dependent setup; the open problem is the remaining identification cost (a condition-free bound on reaching the optimal face) and lower bounds. Accuracy is not the obstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。