提出线性化方法,让偏格罗莫夫-沃瑟斯坦计算更快且保持精度。
Linear Partial Gromov-Wasserstein Embedding
- 将偏格罗莫夫-沃瑟斯坦距离的计算从O(K²)降至O(K)次求解。
- 在形状检索和基于传输的嵌入任务中,效率提升显著且匹配效果良好。
- 适合需要快速比较异质度量空间数据的研究者使用。
格罗莫夫-沃瑟斯坦(GW)问题作为经典最优传输的变体,因其能衡量不同度量空间中测度间的相似性,受到机器学习与数据科学领域的广泛关注。然而,与经典最优传输类似,GW强加了质量相等的约束,限制了其在众多机器学习任务中的应用。为此,提出了偏格罗莫夫-沃瑟斯坦(PGW)问题,放宽了质量相等约束,允许对一般正的Radon测度进行比较。尽管如此,GW和PGW均因非凸性面临严重计算挑战。为此,本文提出线性偏格罗莫夫-沃瑟斯坦(LPGW)嵌入,一种针对PGW问题的线性化嵌入技术。对于K个不同的度量测度空间,两两计算PGW距离需求解PGW问题O(K²)次;而所提方法仅需O(K)次。类似于经典最优传输的线性化,我们证明了LPGW在度量测度空间上定义了一个有效度量。最后,我们在形状检索和基于传输的嵌入学习中验证了LPGW的有效性,表明其在保持PGW部分匹配优势的同时,显著提升了计算效率。代码已开源:https://github.com/mint-vu/Linearized_Partial_Gromov_Wasserstein。
原文摘要 · Abstract (English)
The Gromov-Wasserstein (GW) problem, a variant of the classical optimal transport (OT) problem, has attracted growing interest in the machine learning and data science communities due to its ability to quantify similarity between measures in different metric spaces. However, like the classical OT problem, GW imposes an equal mass constraint between measures, which restricts its application in many machine learning tasks. To address this limitation, the partial Gromov-Wasserstein (PGW) problem has been introduced. It relaxes the equal mass constraint, allowing the comparison of general positive Radon measures. Despite this, both GW and PGW face significant computational challenges due to their non-convex nature. To overcome these challenges, we propose the linear partial Gromov-Wasserstein (LPGW) embedding, a linearized embedding technique for the PGW problem. For $K$ different metric measure spaces, the pairwise computation of the PGW distance requires solving the PGW problem ${O}(K^2)$ times. In contrast, the proposed linearization technique reduces this to ${O}(K)$ times. Similar to the linearization technique for the classical OT problem, we prove that LPGW defines a valid metric for metric measure spaces. Finally, we demonstrate the effectiveness of LPGW in practical applications such as shape retrieval and learning with transport-based embeddings, showing that LPGW preserves the advantages of PGW in partial matching while significantly enhancing computational efficiency. The code is available at https://github.com/mint-vu/Linearized_Partial_Gromov_Wasserstein.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。