提出可学习锚点的多视图聚类方法,实现线性时间高效聚类。
Towards Learnable Anchor for Deep Multi-View Clustering
- 用噪声干预锚点并设计优化损失,使锚点可训练
- 在多个数据集上达到更优聚类性能和速度
- 适合大规模多视图数据聚类任务
深度多视图聚类结合图学习展现出巨大潜力,但现有方法通常面临与数据规模呈平方关系的时间开销。理论上,基于锚点的图学习可缓解此问题,但现有深度模型多依赖人工离散化选择锚点,导致锚点固定且可能偏离真实聚类分布,进而影响聚类结果。本文提出深度多视图锚点聚类(DMAC)模型,实现线性时间聚类。具体地,初始锚点通过来自高斯分布的正向激励噪声进行干预,使其可通过新设计的锚点学习损失进行优化,从而增强样本与锚点间的清晰关系。随后,设计锚点图卷积以建模锚点形成的聚类结构,并构建互信息最大化损失以提供跨视图聚类指导。由此,学习到的锚点能更好表征聚类。最终,基于最优锚点计算完整样本图,获得用于聚类的判别性嵌入。在多个数据集上的大量实验表明,相比当前最优方法,DMAC在性能和效率上均表现更优。
原文摘要 · Abstract (English)
Deep multi-view clustering incorporating graph learning has presented tremendous potential. Most methods encounter costly square time consumption w.r.t. data size. Theoretically, anchor-based graph learning can alleviate this limitation, but related deep models mainly rely on manual discretization approaches to select anchors, which indicates that 1) the anchors are fixed during model training and 2) they may deviate from the true cluster distribution. Consequently, the unreliable anchors may corrupt clustering results. In this paper, we propose the Deep Multi-view Anchor Clustering (DMAC) model that performs clustering in linear time. Concretely, the initial anchors are intervened by the positive-incentive noise sampled from Gaussian distribution, such that they can be optimized with a newly designed anchor learning loss, which promotes a clear relationship between samples and anchors. Afterwards, anchor graph convolution is devised to model the cluster structure formed by the anchors, and the mutual information maximization loss is built to provide cross-view clustering guidance. In this way, the learned anchors can better represent clusters. With the optimal anchors, the full sample graph is calculated to derive a discriminative embedding for clustering. Extensive experiments on several datasets demonstrate the superior performance and efficiency of DMAC compared to state-of-the-art competitors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。