分离异质与同质关系,提升多模态图聚类效果
Disentangling Homophily and Heterophily in Multimodal Graph Clustering
- 将图结构分解为同质和异质两个视角,分别捕捉类别一致性和模态差异
- 在多个数据集上达到最优性能,显著优于现有方法
- 适合多模态数据融合、无监督学习研究者参考
多模态图整合非结构化异构数据与结构化关联,在现实应用中具有重要意义,但在无监督学习中仍研究不足。本文首次系统研究多模态图聚类问题。通过实证分析发现,真实多模态图常呈现同质与异质混合的邻居模式。为此,我们提出新框架 extsc{Disentangled Multimodal Graph Clustering (DMGC)},将原图解耦为两类互补视图:(1) 增强同质性图,保留跨模态类别一致性;(2) 敏感异质性图,保持模态特异的类间区分。引入 extit{Multimodal Dual-frequency Fusion} 机制,通过双通道策略联合过滤解耦图,实现有效多模态融合并减少类别混淆。自监督对齐目标在无需标签条件下引导学习过程。在多模态与多关系图数据集上的大量实验表明,DMGC 实现了当前最佳性能,验证了其有效性与泛化能力。代码已开源:https://github.com/Uncnbb/DMGC。
原文摘要 · Abstract (English)
Multimodal graphs, which integrate unstructured heterogeneous data with structured interconnections, offer substantial real-world utility but remain insufficiently explored in unsupervised learning. In this work, we initiate the study of multimodal graph clustering, aiming to bridge this critical gap. Through empirical analysis, we observe that real-world multimodal graphs often exhibit hybrid neighborhood patterns, combining both homophilic and heterophilic relationships. To address this challenge, we propose a novel framework -- \textsc{Disentangled Multimodal Graph Clustering (DMGC)} -- which decomposes the original hybrid graph into two complementary views: (1) a homophily-enhanced graph that captures cross-modal class consistency, and (2) heterophily-aware graphs that preserve modality-specific inter-class distinctions. We introduce a \emph{Multimodal Dual-frequency Fusion} mechanism that jointly filters these disentangled graphs through a dual-pass strategy, enabling effective multimodal integration while mitigating category confusion. Our self-supervised alignment objectives further guide the learning process without requiring labels. Extensive experiments on both multimodal and multi-relational graph datasets demonstrate that DMGC achieves state-of-the-art performance, highlighting its effectiveness and generalizability across diverse settings. Our code is available at https://github.com/Uncnbb/DMGC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。