提出新方法提升特征解耦,让分类更准更鲁棒
OSCS-SupCon: Orthogonal Sigmoid-based Common and Style Supervised Contrastive Learning for Robust Feature Disentanglement

- 用可学习参数调节对比损失边界,缓解负样本干扰
- 强制类别相关与无关特征正交,减少特征混杂
- 在6个数据集上超越现有方法,细粒度识别提升3.4%
监督对比学习(SupCon)通过显式建模样本间关系取得了优异性能。然而现有方法存在两大缺陷:标准InfoNCE损失导致负样本稀释,缺乏对类别相关(共性)与无关(风格)特征的显式分离机制,造成特征空间纠缠,降低判别力与泛化能力。为此,我们提出OSCS-SupCon(基于正弦的共性与风格监督对比学习),融合基于sigmoid的成对对比目标与显式正交约束。具体地,引入含可学习温度与偏置参数的sigmoid对比损失,自适应调节成对决策边界,缓解负样本稀释;并通过带ReLU非线性的线性投影,强制共性与风格子空间正交,减少特征重叠,提升风格无关表示的解耦效果。在六个基准数据集上的大量实验表明,OSCS-SupCon在多种骨干网络下持续优于当前最优监督对比学习方法。尤其在使用ResNet-18的细粒度CUB200-2011数据集上,相比CS-SupCon提升3.4%分类准确率,凸显其鲁棒性与泛化能力。消融实验进一步验证各组件有效性。
原文摘要 · Abstract (English)
Supervised Contrastive Learning (SupCon) has achieved strong performance by explicitly modeling pairwise relationships among samples. However, existing SupCon-based methods suffer from two key limitations: negative-sample dilution induced by the standard InfoNCE loss, and feature-space entanglement caused by the lack of explicit constraints separating category-relevant (common) and category-irrelevant (style) features. These limitations reduce feature discriminability and generalization ability. To address these issues, we propose OSCS-SupCon (Orthogonal Sigmoid-based Common and Style Supervised Contrastive Learning), a unified framework that combines a sigmoid-based pairwise contrastive objective with explicit orthogonality constraints. Specifically, we introduce a sigmoid-based contrastive loss with two learnable parameters, temperature and bias, which adaptively modulate pairwise decision boundaries and alleviate negative-sample dilution. Furthermore, we enforce orthogonality between common and style feature subspaces via a linear projection with ReLU nonlinearity, thereby reducing feature overlap and improving disentanglement of style-irrelevant representations. Extensive experiments on six benchmark datasets demonstrate that OSCS-SupCon consistently outperforms state-of-the-art supervised contrastive learning methods across multiple backbone architectures. In particular, on the fine-grained CUB200-2011 dataset with a ResNet-18 backbone, the proposed method achieves a 3.4% improvement in classification accuracy over CS-SupCon, highlighting its robustness and generalization capability. Ablation studies further confirm the effectiveness of each component.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。