arXiv:2506.06231cs.LGcs.AI2025-06ICML被引 11

通过谱分析对比嵌入模型,揭示聚类差异并实现对齐。

Towards an Explainable Comparison and Alignment of Feature Embeddings

  • 基于核矩阵差的谱分解,识别两嵌入模型聚类差异。
  • 线性复杂度实现大规模数据集上的可扩展比较。
  • 适用于需要解释性对齐的视觉嵌入模型研究。

尽管已有多种特征嵌入模型,但现有比较多聚焦于分类下游任务的数值表现。可解释的嵌入对比需识别嵌入空间中样本簇的不匹配。本文提出谱成对嵌入比较(SPEC)框架,通过分析两个嵌入的核矩阵,利用差值核矩阵的特征分解,检测在聚类上表现不同的样本簇。我们实现了该方法的可扩展版本,计算复杂度随样本数线性增长。此外,引入优化问题以对齐两个嵌入,确保一个模型中的簇在另一模型中也被捕捉。在ImageNet和MS-COCO等大规模数据集上验证了SPEC在嵌入对比与对齐中的有效性。

原文摘要 · Abstract (English)

While several feature embedding models have been developed in the literature, comparisons of these embeddings have largely focused on their numerical performance in classification-related downstream applications. However, an interpretable comparison of different embeddings requires identifying and analyzing mismatches between sample groups clustered within the embedding spaces. In this work, we propose the \emph{Spectral Pairwise Embedding Comparison (SPEC)} framework to compare embeddings and identify their differences in clustering a reference dataset. Our approach examines the kernel matrices derived from two embeddings and leverages the eigendecomposition of the difference kernel matrix to detect sample clusters that are captured differently by the two embeddings. We present a scalable implementation of this kernel-based approach, with computational complexity that grows linearly with the sample size. Furthermore, we introduce an optimization problem using this framework to align two embeddings, ensuring that clusters identified in one embedding are also captured in the other model. We provide numerical results demonstrating the SPEC's application to compare and align embeddings on large-scale datasets such as ImageNet and MS-COCO. The project page is available at https://mjalali.github.io/SPEC/.

嵌入对比聚类分析可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。