arXiv:2507.19917cs.CVcs.AI2025-07被引 1

提出小批量训练方法,让深度子空间聚类可扩展处理高分辨率图像。

A mini-batch training strategy for deep subspace clustering networks

  • 用记忆库保存全局特征,实现小批量训练下的子空间聚类
  • 在COIL100和ORL数据集上性能优于现有方法
  • 无需解码器,结合对比学习提升效率,适合大模型微调

小批量训练是现代深度学习的核心,具备计算高效与可扩展性。然而,现有深度子空间聚类(DSC)方法通常结合自编码器与自表达层,依赖全批量处理。瓶颈在于自表达模块需使用整个数据集的表示来构建自表达系数矩阵。本文提出一种基于记忆库的DSC小批量训练策略,保留全局特征表示,使高分辨率图像的深度架构可扩展训练成为可能。此外,为高效微调大规模预训练编码器,我们设计了一种无解码器框架,采用对比学习替代自编码进行表征学习。该设计不仅避免了解码器训练的计算开销,还取得具有竞争力的性能。大量实验表明,本方法性能可媲美全批量方法,并在COIL100与ORL数据集上优于其他先进子空间聚类方法。

原文摘要 · Abstract (English)

Mini-batch training is a cornerstone of modern deep learning, offering computational efficiency and scalability for training complex architectures. However, existing deep subspace clustering (DSC) methods, which typically combine an autoencoder with a self-expressive layer, rely on full-batch processing. The bottleneck arises from the self-expressive module, which requires representations of the entire dataset to construct a self-representation coefficient matrix. In this work, we introduce a mini-batch training strategy for DSC by integrating a memory bank that preserves global feature representations. Our approach enables scalable training of deep architectures for subspace clustering with high-resolution images, overcoming previous limitations. Additionally, to efficiently fine-tune large-scale pre-trained encoders for subspace clustering, we propose a decoder-free framework that leverages contrastive learning instead of autoencoding for representation learning. This design not only eliminates the computational overhead of decoder training but also provides competitive performance. Extensive experiments demonstrate that our approach not only achieves performance comparable to full-batch methods, but outperforms other state-of-the-art subspace clustering methods on the COIL100 and ORL datasets by fine-tuning deep networks.

子空间聚类小批量训练对比学习深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。