arXiv:2501.02564cs.CVcs.AI2025-01TPAMI被引 2

解决多视图聚类中视图信息不均衡问题,提升模型对多视角特征的利用效率。

Balanced Multi-view Clustering

  • 引入视图特异性对比正则化,动态调节各视图特征提取器的优化过程。
  • 在8个基准数据集上超越当前最优方法,显著提升聚类性能。
  • 适合需要融合多源异构数据的聚类任务,如生物信息学、多模态图像分析。

多视图聚类(MvC)旨在整合不同视图的信息以增强模型捕捉数据潜在结构的能力。现有广泛采用的联合训练范式可能无法充分挖掘多视图信息,因为所有视图使用统一的学习目标导致视图特异性特征不平衡且欠优化。例如,具有更强判别性的特定视图可能在联合训练中主导学习过程,使其他视图被低估。为此,本文从梯度下降角度分析了联合训练中视图不平衡现象,并提出一种新的平衡多视图聚类(BMvC)方法。该方法引入视图特异性对比正则化(VCR),将联合特征与视图特异性特征所捕获的样本相似性保留在对应视图特异性特征的聚类分布中,以增强视图特异性特征提取器的学习。此外,理论分析表明,VCR能自适应调节视图特异性特征提取器参数更新的梯度幅度,实现均衡的多视图学习。由此,BMvC在挖掘视图特异性模式与探索视图不变模式之间取得更好权衡,充分学习多视图信息用于聚类任务。大量实验验证了该方法在8个基准多视图聚类数据集上优于当前先进方法。

原文摘要 · Abstract (English)

Multi-view clustering (MvC) aims to integrate information from different views to enhance the capability of the model in capturing the underlying data structures. The widely used joint training paradigm in MvC is potentially not fully leverage the multi-view information, since the imbalanced and under-optimized view-specific features caused by the uniform learning objective for all views. For instance, particular views with more discriminative information could dominate the learning process in the joint training paradigm, leading to other views being under-optimized. To alleviate this issue, we first analyze the imbalanced phenomenon in the joint-training paradigm of multi-view clustering from the perspective of gradient descent for each view-specific feature extractor. Then, we propose a novel balanced multi-view clustering (BMvC) method, which introduces a view-specific contrastive regularization (VCR) to modulate the optimization of each view. Concretely, VCR preserves the sample similarities captured from the joint features and view-specific ones into the clustering distributions corresponding to view-specific features to enhance the learning process of view-specific feature extractors. Additionally, a theoretical analysis is provided to illustrate that VCR adaptively modulates the magnitudes of gradients for updating the parameters of view-specific feature extractors to achieve a balanced multi-view learning procedure. In such a manner, BMvC achieves a better trade-off between the exploitation of view-specific patterns and the exploration of view-invariance patterns to fully learn the multi-view information for the clustering task. Finally, a set of experiments are conducted to verify the superiority of the proposed method compared with state-of-the-art approaches on eight benchmark MvC datasets.

多视图聚类对比学习特征平衡深度聚类

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。