用树形结构加速最优传输距离计算,提升无监督聚类效率
Fast unsupervised ground metric learning with tree-Wasserstein distance
- 将样本与特征嵌入树结构,通过树形沃尔什距离近似传统方法
- 计算复杂度降至O(n³ + m³ + mn),比原方法快数个数量级
- 适用于单细胞基因组数据等大规模无监督聚类任务
无监督聚类性能依赖于特征间的距离度量(即基础度量)。传统方法常采用启发式或有监督学习方式确定度量,但面对大量无标签数据时,需发展无监督基础度量学习。一种有前景的方法是利用沃尔什奇异向量(WSVs),它在同时计算特征与样本间最优传输距离时自然出现。然而,该方法计算成本极高:复杂度为O(n²m²(n log n + m log m)),其中n为样本数,m为特征数。本文提出将样本和特征嵌入树结构,并在树上计算树形沃尔什距离(TWD)。理论与实证表明,该算法对标准WSV方法的逼近效果优于现有最佳替代方案,且复杂度仅为O(n³ + m³ + mn)。此外,我们证明初始树结构可灵活选择,因为树几何不约束逼近能力,仅受限于边权重数量。基于此,我们设计了一种快速递归算法来计算树参数基集,这对大规模应用中的效率提升至关重要。最后,我们将树-WSV算法应用于多个单细胞RNA测序基因组数据集,验证了其可扩展性与在无监督细胞类型聚类中的实用性。结果表明,基于TWD的无监督基础度量学习是一种低秩近似方法,具有广泛的应用潜力。
原文摘要 · Abstract (English)
The performance of unsupervised methods such as clustering depends on the choice of distance metric between features, or ground metric. Commonly, ground metrics are decided with heuristics or learned via supervised algorithms. However, since many interesting datasets are unlabelled, unsupervised ground metric learning approaches have been introduced. One promising option employs Wasserstein singular vectors (WSVs), which emerge when computing optimal transport distances between features and samples simultaneously. WSVs are effective, but can be prohibitively computationally expensive in some applications: $\mathcal{O}(n^2m^2(n \log(n) + m \log(m))$ for $n$ samples and $m$ features. In this work, we propose to augment the WSV method by embedding samples and features on trees, on which we compute the tree-Wasserstein distance (TWD). We demonstrate theoretically and empirically that the algorithm converges to a better approximation of the standard WSV approach than the best known alternatives, and does so with $\mathcal{O}(n^3+m^3+mn)$ complexity. In addition, we prove that the initial tree structure can be chosen flexibly, since tree geometry does not constrain the richness of the approximation up to the number of edge weights. This proof suggests a fast and recursive algorithm for computing the tree parameter basis set, which we find crucial to realising the efficiency gains at scale. Finally, we employ the tree-WSV algorithm to several single-cell RNA sequencing genomics datasets, demonstrating its scalability and utility for unsupervised cell-type clustering problems. These results poise unsupervised ground metric learning with TWD as a low-rank approximation of WSV with the potential for widespread application.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。