解析α=0为何让布拉德利-特瑞模型迭代更快收敛
Convergence analysis of a family of Zermelo-type iterations for the Bradley--Terry model
- 通过雅可比矩阵谱分析,揭示参数α对收敛速度的影响机制
- 发现异步更新下α=0收敛最快,且随α增大收敛因子单调上升
- 理论证明α=0在异步场景最优,解释实际中加速现象的根源
Zermelo算法是计算布拉德利-特瑞(BT)模型最大似然估计的经典方法,但实际收敛可能较慢。Newman提出一族参数为α的Zermelo型不动点迭代,当α=1时即为原算法。经验表明α=0常显著加速收敛,但其机理尚不明确。本文通过系统局部收敛分析,推导出同步与异步更新下的闭式收敛因子表达式,并基于雅可比矩阵谱分析其对α的依赖关系。在同步更新下,当α<1时算法可能不收敛,且收敛因子在总体BT模型下呈准凸性;而在异步更新下始终局部收敛,且收敛因子在一致排序的二分比较图总体模型下严格随α递增,证明了α=0在此情形下的最优性。进一步建立了总体收敛因子的渐近近似结果,验证其实际相关性。合成与真实数据集上的数值实验验证了理论。分析补充了现有收敛结果,表明α=0的加速不仅源于参数选择,更关键在于异步更新机制。
原文摘要 · Abstract (English)
Zermelo's algorithm is a classical method for computing the maximum likelihood estimator in the Bradley--Terry (BT) model, but its convergence can be slow in practice. To accelerate computation, Newman introduced a family of Zermelo-type fixed-point iterations parameterized by $α$, with Zermelo's algorithm recovered at $α=1$. Empirical evidence suggests that the choice $α=0$ often converges substantially faster, making it a promising alternative, yet the mechanism underlying this acceleration remains elusive. This paper provides theoretical insight into this phenomenon through a systematic local convergence analysis. We derive closed-form expressions for local convergence factors under synchronous and asynchronous updates and analyze their dependence on $α$ via spectral analysis of the associated Jacobian matrices. For synchronous updates, we show that the algorithm may fail to converge when $α<1$, and its local convergence factor is quasi-convex in $α$ under the population BT model. In contrast, asynchronous updates are always locally convergent, and their local convergence factor is provably monotonically increasing in $α$ under the population BT model of consistently ordered bipartite comparison graphs, establishing the optimality of $α=0$ in this setting. We further establish asymptotic approximation results for the population convergence factors under the BT model, justifying their practical relevance. Numerical experiments on synthetic and real-world datasets confirm the theory. Our analysis complements existing convergence results and shows that the acceleration of $α=0$ arises not only from the parameter choice but, more importantly, from the use of asynchronous updates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。