arXiv:2506.07413cs.LGcs.CV2025-06NeurIPS被引 7

用变分推断重构对比学习,提升模型泛化与特征清晰度

Variational Supervised Contrastive Learning

  • 将监督对比学习建模为隐变量的变分推断,优化嵌入分布
  • 在ImageNet-1K上达79.36%准确率,200轮收敛且少依赖数据增强
  • 特征空间更清晰,适合小样本学习和鲁棒性要求高的场景

对比学习在多模态表征学习中表现高效,但存在两大缺陷:(1)缺乏对嵌入分布的显式调控,导致语义相关样本被无意分开;(2)过度依赖大批次负样本和定制化增强,影响泛化能力。为此,我们提出变分监督对比学习(VarCon),将监督对比学习重新建模为对隐类变量的变分推断,最大化后验加权的证据下界(ELBO),以实现高效的类别感知匹配,并精细控制嵌入空间内的类内离散度。仅在图像数据上训练,我们在CIFAR-10、CIFAR-100、ImageNet-100和ImageNet-1K上的实验表明,VarCon(1)在对比学习框架中达到顶尖性能,在使用ResNet-50编码器时,ImageNet-1K上达到79.36%的Top-1准确率,CIFAR-100上达78.29%,仅需200个训练周期即可收敛;(2)显著改善决策边界清晰度与嵌入空间语义组织,通过KNN分类、层次聚类和迁移学习验证;(3)在少样本学习中优于监督基线,并在多种增强策略下表现出更强鲁棒性。代码已开源。

原文摘要 · Abstract (English)

Contrastive learning has proven to be highly efficient and adaptable in shaping representation spaces across diverse modalities by pulling similar samples together and pushing dissimilar ones apart. However, two key limitations persist: (1) Without explicit regulation of the embedding distribution, semantically related instances can inadvertently be pushed apart unless complementary signals guide pair selection, and (2) excessive reliance on large in-batch negatives and tailored augmentations hinders generalization. To address these limitations, we propose Variational Supervised Contrastive Learning (VarCon), which reformulates supervised contrastive learning as variational inference over latent class variables and maximizes a posterior-weighted evidence lower bound (ELBO) that replaces exhaustive pair-wise comparisons for efficient class-aware matching and grants fine-grained control over intra-class dispersion in the embedding space. Trained exclusively on image data, our experiments on CIFAR-10, CIFAR-100, ImageNet-100, and ImageNet-1K show that VarCon (1) achieves state-of-the-art performance for contrastive learning frameworks, reaching 79.36% Top-1 accuracy on ImageNet-1K and 78.29% on CIFAR-100 with a ResNet-50 encoder while converging in just 200 epochs; (2) yields substantially clearer decision boundaries and semantic organization in the embedding space, as evidenced by KNN classification, hierarchical clustering results, and transfer-learning assessments; and (3) demonstrates superior performance in few-shot learning than supervised baseline and superior robustness across various augmentation strategies. Our code is available at https://github.com/ziwenwang28/VarContrast.

对比学习变分推断少样本学习图像表征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。