arXiv:2507.06560cs.CVcs.LG2025-07KDD

用分布发散度衡量多视图相似性,提升对比学习效果

Divergence-Based Similarity Function for Multi-View Contrastive Learning

  • 将多视图数据建模为分布,通过分布间发散度计算相似性
  • 在多种任务中表现更优,且无需调温度超参数
  • 适合追求高效高精度的多视图对比学习研究者

对比学习近年取得成功,促使人们更关注如何有效利用数据的多个增强视图。现有方法通常在损失或特征层面融合多视图,但主要捕捉成对关系,难以建模所有视图间的联合结构。本文提出一种基于发散度的相似性函数(DSF),通过将每组增强视图表示为分布,并以分布间发散度衡量相似性,显式建模联合结构。大量实验表明,DSF在kNN分类、线性评估、迁移学习和分布偏移等多种任务中均持续提升性能,且比其他多视图方法更具效率。此外,我们建立了DSF与余弦相似性的联系,证明其无需调节温度超参数即可有效工作。

原文摘要 · Abstract (English)

Recent success in contrastive learning has sparked growing interest in more effectively leveraging multiple augmented views of data. While prior methods incorporate multiple views at the loss or feature level, they primarily capture pairwise relationships and fail to model the joint structure across all views. In this work, we propose a divergence-based similarity function (DSF) that explicitly captures the joint structure by representing each set of augmented views as a distribution and measuring similarity as the divergence between distributions. Extensive experiments demonstrate that DSF consistently improves performance across diverse tasks, including kNN classification, linear evaluation, transfer learning, and distribution shift, while also achieving greater efficiency than other multi-view methods. Furthermore, we establish a connection between DSF and cosine similarity, and demonstrate that, unlike cosine similarity, DSF operates effectively without the need for tuning a temperature hyperparameter.

对比学习多视图相似性度量无温度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。