arXiv:2604.01740cs.LGcs.NE2026-04被引 1

提出可端到端训练的原型表示学习框架,解决特征与聚类脱节问题。

DDCL: Deep Dual Competitive Learning: A Differentiable End-to-End Framework for Unsupervised Prototype-Based Representation Learning

  • 用可微的双竞争层替代传统k-means,生成可训练的原型
  • 在6个实验中聚类准确率比非可微基线提升65%,比DeepCluster高122%
  • 理论证明损失函数具自调节机制,防止原型坍塌

深度聚类的一个持续性结构缺陷是特征学习与聚类分配之间的脱节。大多数架构依赖外部聚类步骤(如k-means)生成伪标签以指导训练,导致主干网络无法直接优化聚类质量。本文提出深度双竞争学习(DDCL),首个针对无监督原型表示学习的完全可微端到端框架。核心创新在于:将外部k-means替换为内部双竞争层(DCL),使原型成为网络原生可微输出。这一单一重构使得从主干特征提取、原型生成到软聚类分配的整个流程可通过单个统一损失进行反向传播训练,无需Lloyd迭代、伪标签离散化或外部聚类步骤。论文从理论上推导出软量化损失的精确代数分解:其由单纯形约束重建误差和非负加权原型方差项组成。该恒等式揭示了损失几何中的自调节机制:方差项梯度作为隐式分离力,无需辅助目标即可抵抗原型坍塌,并导出简化冻结编码器系统的全局李雅普诺夫稳定性定理。六组受控实验验证了各项结构预测:分解恒等式在超过十万次训练周期中无一例外;负反馈循环经皮尔逊相关验证为-0.98;联合训练主干时,DDCL在聚类准确率上比非可微消融模型高65%,比DeepCluster端到端方法高出122%。

原文摘要 · Abstract (English)

A persistent structural weakness in deep clustering is the disconnect between feature learning and cluster assignment. Most architectures invoke an external clustering step, typically k-means, to produce pseudo-labels that guide training, preventing the backbone from directly optimising for cluster quality. This paper introduces Deep Dual Competitive Learning (DDCL), the first fully differentiable end-to-end framework for unsupervised prototype-based representation learning. The core contribution is architectural: the external k-means is replaced by an internal Dual Competitive Layer (DCL) that generates prototypes as native differentiable outputs of the network. This single inversion makes the complete pipeline, from backbone feature extraction through prototype generation to soft cluster assignment, trainable by backpropagation through a single unified loss, with no Lloyd iterations, no pseudo-label discretisation, and no external clustering step. To ground the framework theoretically, the paper derives an exact algebraic decomposition of the soft quantisation loss into a simplex-constrained reconstruction error and a non-negative weighted prototype variance term. This identity reveals a self-regulating mechanism built into the loss geometry: the gradient of the variance term acts as an implicit separation force that resists prototype collapse without any auxiliary objective, and leads to a global Lyapunov stability theorem for the reduced frozen-encoder system. Six blocks of controlled experiments validate each structural prediction. The decomposition identity holds with zero violations across more than one hundred thousand training epochs; the negative feedback cycle is confirmed with Pearson -0.98; with a jointly trained backbone, DDCL outperforms its non-differentiable ablation by 65% in clustering accuracy and DeepCluster end-to-end by 122%.

聚类可微学习原型表示无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。