提出动态图学习框架,解决多视图聚类中缺失数据与图重建噪声问题。
Dynamic Deep Graph Learning for Incomplete Multi-View Clustering with Masked Graph Reconstruction Loss
- 基于全局图构建动态视图图结构,实现缺失视图的鲁棒补全。
- 引入掩码图重建损失,显著降低优化过程中的梯度噪声。
- 适合处理含缺失数据的多视图聚类任务,尤其在数据不完整场景下表现优异。
现实世界中的多视图数据普遍存在,使得不完整多视图聚类(IMVC)成为关键研究方向。图神经网络(GNNs)的发展使其成为主流多视图聚类方法之一。尽管基于GNN的IMVC取得显著进展,仍面临两大挑战:(1) 多数方法依赖K近邻(KNN)算法从原始数据构建静态图,引入噪声并削弱图拓扑鲁棒性;(2) 现有方法通常直接使用重构图与稀疏邻接图之间的均方误差(MSE)作为图重建损失,导致优化过程中产生大量梯度噪声。为此,本文提出一种新型动态深度图学习框架——带有掩码图重建损失的不完整多视图聚类(DGIMVCM)。首先,从原始数据构建抗缺失的全局图,并设计图卷积嵌入层以提取主特征和精细化的动态视图特定图结构,利用全局图对缺失视图进行补全。该过程结合图结构对比学习,识别视图间图结构的一致性。其次,引入图自注意力编码器,基于补全后的主特征与视图特定图提取高层表示,并通过掩码图重建损失进行优化,有效缓解梯度噪声。最后,构建聚类模块并通过伪标签自监督训练机制优化。在多个数据集上的大量实验验证了DGIMVCM的有效性与优越性。
原文摘要 · Abstract (English)
The prevalence of real-world multi-view data makes incomplete multi-view clustering (IMVC) a crucial research. The rapid development of Graph Neural Networks (GNNs) has established them as one of the mainstream approaches for multi-view clustering. Despite significant progress in GNNs-based IMVC, some challenges remain: (1) Most methods rely on the K-Nearest Neighbors (KNN) algorithm to construct static graphs from raw data, which introduces noise and diminishes the robustness of the graph topology. (2) Existing methods typically utilize the Mean Squared Error (MSE) loss between the reconstructed graph and the sparse adjacency graph directly as the graph reconstruction loss, leading to substantial gradient noise during optimization. To address these issues, we propose a novel \textbf{D}ynamic Deep \textbf{G}raph Learning for \textbf{I}ncomplete \textbf{M}ulti-\textbf{V}iew \textbf{C}lustering with \textbf{M}asked Graph Reconstruction Loss (DGIMVCM). Firstly, we construct a missing-robust global graph from the raw data. A graph convolutional embedding layer is then designed to extract primary features and refined dynamic view-specific graph structures, leveraging the global graph for imputation of missing views. This process is complemented by graph structure contrastive learning, which identifies consistency among view-specific graph structures. Secondly, a graph self-attention encoder is introduced to extract high-level representations based on the imputed primary features and view-specific graphs, and is optimized with a masked graph reconstruction loss to mitigate gradient noise during optimization. Finally, a clustering module is constructed and optimized through a pseudo-label self-supervised training mechanism. Extensive experiments on multiple datasets validate the effectiveness and superiority of DGIMVCM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。