arXiv:2512.02152cs.CV2025-12被引 7

新损失函数提升对比学习效果,减少数据增强带来的信息扭曲。

Context-Enriched Contrastive Loss: Enhancing Presentation of Inherent Sample Connections in Contrastive Learning Framework

  • 引入双目标损失,同时优化类别间差异与同一图像的增强样本关联。
  • 在8个基准数据集上超越16种先进方法,收敛速度更快,泛化能力更强。
  • 特别适合处理数据偏差问题,对有偏数据集提升达22.9%。

对比学习在众多大规模基准上表现优异。然而,现有方法依赖增强样本可能导致信息扭曲:模型过度依赖同标签样本,忽视源自同一原始图像的正样本对,尤其在大规模数据集下更为明显。本文提出一种上下文增强型对比损失函数,包含两个收敛目标:第一,增强类别间区分能力,提升训练效率;第二,拉近同一图像生成的增强样本距离,推远其他所有样本。在包括CIFAR10、CIFAR100、Caltech-101、Caltech-256、ImageNet、BiasedMNIST、UTKFace和CelebA在内的8个主流图像识别基准上验证,结果表明该方法在泛化性能和收敛速度上均优于16种现有对比学习方法。尤其在有偏的BiasedMNIST数据集上,相比原始对比损失提升22.9%,显著改善系统性偏差问题,为更高效、公平的下游训练提供可能。

原文摘要 · Abstract (English)

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between samples through techniques such as rotation or cropping. However, this learning mechanism can also introduce information distortion from the augmented samples. This is because the trained model may develop a significant overreliance on information from samples with identical labels, while concurrently neglecting positive pairs that originate from the same initial image, especially in expansive datasets. This paper proposes a context-enriched contrastive loss function that concurrently improves learning effectiveness and addresses the information distortion by encompassing two convergence targets. The first component, which is notably sensitive to label contrast, differentiates between features of identical and distinct classes which boosts the contrastive training efficiency. Meanwhile, the second component draws closer the augmented samples from the same source image and distances all other samples. We evaluate the proposed approach on image classification tasks, which are among the most widely accepted 8 recognition large-scale benchmark datasets: CIFAR10, CIFAR100, Caltech-101, Caltech-256, ImageNet, BiasedMNIST, UTKFace, and CelebA datasets. The experimental results demonstrate that the proposed method achieves improvements over 16 state-of-the-art contrastive learning methods in terms of both generalization performance and learning convergence speed. Interestingly, our technique stands out in addressing systematic distortion tasks. It demonstrates a 22.9% improvement compared to original contrastive loss functions in the downstream BiasedMNIST dataset, highlighting its promise for more efficient and equitable downstream training.

对比学习损失函数数据偏差图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。