arXiv:2607.12916cs.LG2026-07

提出新损失函数CoCo,让模型更快收敛且类别间更清晰分离。

Contrastive-Collapsed Loss for Flexible and Geometrically Optimal Embeddings and Faster Convergence

论文配图:Contrastive-Collapsed Loss for Flexible and Geometrically Optimal Embeddings and Faster Convergence
图 1 · 摘自论文原文
  • 通过内聚外斥机制,促进类内紧凑、类间分离的嵌入结构。
  • 在多个数据集上达到顶尖性能,收敛速度比现有方法快20%以上。
  • 适合需要快速训练和高判别性表示的分类任务,如医疗诊断。

本文提出CoCo损失函数,用于学习归一化且结构良好的表征。该损失在鼓励类内坍缩与类间对比的同时,保留神经网络逼近几何最优嵌入的灵活性,实现类间大角度分离。理论分析表明,相比点积回归和交叉熵等目标,CoCo具有更接近最优配置的初始化、更具信息量的梯度和更强的类内坍缩激励。在OpenML-CC18基准的多样化表格数据集上,CoCo表现媲美当前最优方法(包括核SVM、随机森林、点积回归和基于交叉熵的神经网络)。理论与实证分析均显示,该方法能实现更紧密的类内聚类并加速收敛。结果表明,CoCo是一种有效学习判别性表示的同时保持优异预测性能的目标函数。

原文摘要 · Abstract (English)

In this work, we introduce CoCo, a loss function aimed at learning normalized and well-structured representations. The proposed loss encourages intra-class collapse and inter-class contrast while preserving sufficient flexibility for neural networks to approximate geometrically optimal embeddings with large angular separation between classes. We provide a theoretical analysis positioning CoCo with respect to related objectives such as dot regression and cross-entropy, showing that the new proposed loss benefits from closer initialization to the optimal configuration, more informative gradients, and stronger incentives for class-wise representation collapse. Extensive experiments on diverse tabular datasets from the OpenML-CC18 benchmark show that CoCo achieves competitive performance with state-of-the-art methods, including kernel SVM, Random Forest, dot regression, and cross-entropy-based neural networks. In addition, both theoretical arguments and empirical analyses demonstrate that the proposal promotes tighter class clustering and faster convergence. These results highlight CoCo loss as an effective objective for learning discriminative representations while maintaining competitive predictive performance.

损失函数表征学习分类优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。