提出用于序列组合最优传输的高效近似算法并分析其收敛性。
Sinkhorn Algorithm for Sequentially Composed Optimal Transports
- 基于熵正则化设计序列组合最优传输的Sinkhorn算法
- 证明算法以指数速度收敛,最坏情况复杂度接近线性
- 适合研究最优传输理论或需层次化匹配的应用者
Sinkhorn算法是求解最优传输问题的主流近似方法,广泛应用于图像处理和自然语言处理。理论上,其收敛性源于矩阵缩放问题的Sinkhorn-Knopp算法,Altschuler等人证明其最坏情况时间复杂度为近线性。最近,Watanabe和Isobe提出了序列组合最优传输作为最优传输的分层扩展。本文针对其熵正则化形式,提出一种高效的近似算法——序列组合最优传输的Sinkhorn算法,并进行理论分析:(i) 在希尔伯特伪度量下指数收敛至最优解;(ii) 对单次序列组合情形给出最坏情况复杂度分析。
原文摘要 · Abstract (English)
Sinkhorn algorithm is the de-facto standard approximation algorithm for optimal transport, which has been applied to a variety of applications, including image processing and natural language processing. In theory, the proof of its convergence follows from the convergence of the Sinkhorn--Knopp algorithm for the matrix scaling problem, and Altschuler et al. show that its worst-case time complexity is in near-linear time. Very recently, sequentially composed optimal transports were proposed by Watanabe and Isobe as a hierarchical extension of optimal transports. In this paper, we present an efficient approximation algorithm, namely Sinkhorn algorithm for sequentially composed optimal transports, for its entropic regularization. Furthermore, we present a theoretical analysis of the Sinkhorn algorithm, namely (i) its exponential convergence to the optimal solution with respect to the Hilbert pseudometric, and (ii) a worst-case complexity analysis for the case of one sequential composition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。