arXiv:2606.11233cs.CV2026-06

提出新方法提升特征解耦,让分类更准更鲁棒

OSCS-SupCon: Orthogonal Sigmoid-based Common and Style Supervised Contrastive Learning for Robust Feature Disentanglement

论文配图:OSCS-SupCon: Orthogonal Sigmoid-based Common and Style Supervised Contrastive Learning for Robust Feature Disentanglement
图 1 · 摘自论文原文
  • 用可学习参数调节对比损失边界,缓解负样本干扰
  • 强制类别相关与无关特征正交,减少特征混杂
  • 在6个数据集上超越现有方法,细粒度识别提升3.4%

监督对比学习(SupCon)通过显式建模样本间关系取得了优异性能。然而现有方法存在两大缺陷:标准InfoNCE损失导致负样本稀释,缺乏对类别相关(共性)与无关(风格)特征的显式分离机制,造成特征空间纠缠,降低判别力与泛化能力。为此,我们提出OSCS-SupCon(基于正弦的共性与风格监督对比学习),融合基于sigmoid的成对对比目标与显式正交约束。具体地,引入含可学习温度与偏置参数的sigmoid对比损失,自适应调节成对决策边界,缓解负样本稀释;并通过带ReLU非线性的线性投影,强制共性与风格子空间正交,减少特征重叠,提升风格无关表示的解耦效果。在六个基准数据集上的大量实验表明,OSCS-SupCon在多种骨干网络下持续优于当前最优监督对比学习方法。尤其在使用ResNet-18的细粒度CUB200-2011数据集上,相比CS-SupCon提升3.4%分类准确率,凸显其鲁棒性与泛化能力。消融实验进一步验证各组件有效性。

原文摘要 · Abstract (English)

Supervised Contrastive Learning (SupCon) has achieved strong performance by explicitly modeling pairwise relationships among samples. However, existing SupCon-based methods suffer from two key limitations: negative-sample dilution induced by the standard InfoNCE loss, and feature-space entanglement caused by the lack of explicit constraints separating category-relevant (common) and category-irrelevant (style) features. These limitations reduce feature discriminability and generalization ability. To address these issues, we propose OSCS-SupCon (Orthogonal Sigmoid-based Common and Style Supervised Contrastive Learning), a unified framework that combines a sigmoid-based pairwise contrastive objective with explicit orthogonality constraints. Specifically, we introduce a sigmoid-based contrastive loss with two learnable parameters, temperature and bias, which adaptively modulate pairwise decision boundaries and alleviate negative-sample dilution. Furthermore, we enforce orthogonality between common and style feature subspaces via a linear projection with ReLU nonlinearity, thereby reducing feature overlap and improving disentanglement of style-irrelevant representations. Extensive experiments on six benchmark datasets demonstrate that OSCS-SupCon consistently outperforms state-of-the-art supervised contrastive learning methods across multiple backbone architectures. In particular, on the fine-grained CUB200-2011 dataset with a ResNet-18 backbone, the proposed method achieves a 3.4% improvement in classification accuracy over CS-SupCon, highlighting its robustness and generalization capability. Ablation studies further confirm the effectiveness of each component.

对比学习特征解耦图像分类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。