arXiv:2503.17288cs.CVcs.LG2025-03ICLR被引 10

提出可防止特征坍缩的深度子空间聚类框架,理论保障学习到正交子空间结构。

Exploring a Principled Framework for Deep Subspace Clustering

  • 引入正则化项统一学习结构化表示与自表达系数
  • 证明在特定条件下可避免特征坍缩并收敛至正交子空间
  • 实验验证方法优于现有模型,适合高维数据聚类任务

子空间聚类是经典无监督学习任务,基于高维数据可由多个子空间联合近似的假设(UoS)。然而真实数据常偏离该假设。现有深度子空间聚类算法虽尝试联合学习UoS表示与自表达系数,但通用框架存在灾难性特征坍缩且缺乏理论保证。本文提出一种原理性深度子空间聚类框架PRO-DSC,通过在自表达模型中引入有效正则化,证明其能防止特征空间坍缩,并在特定条件下确保最优表示位于正交子空间的并集上。此外,我们设计了高效可扩展的实现方法,通过大量实验验证理论结论并展示所提方法在性能上的显著优势。代码已开源。

原文摘要 · Abstract (English)

Subspace clustering is a classical unsupervised learning task, built on a basic assumption that high-dimensional data can be approximated by a union of subspaces (UoS). Nevertheless, the real-world data are often deviating from the UoS assumption. To address this challenge, state-of-the-art deep subspace clustering algorithms attempt to jointly learn UoS representations and self-expressive coefficients. However, the general framework of the existing algorithms suffers from a catastrophic feature collapse and lacks a theoretical guarantee to learn desired UoS representation. In this paper, we present a Principled fRamewOrk for Deep Subspace Clustering (PRO-DSC), which is designed to learn structured representations and self-expressive coefficients in a unified manner. Specifically, in PRO-DSC, we incorporate an effective regularization on the learned representations into the self-expressive model, prove that the regularized self-expressive model is able to prevent feature space collapse, and demonstrate that the learned optimal representations under certain condition lie on a union of orthogonal subspaces. Moreover, we provide a scalable and efficient approach to implement our PRO-DSC and conduct extensive experiments to verify our theoretical findings and demonstrate the superior performance of our proposed deep subspace clustering approach. The code is available at https://github.com/mengxianghan123/PRO-DSC.

子空间聚类深度学习无监督学习正则化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。