针对多模态图数据中属性缺失或噪声问题,提出自适应可靠性感知的聚类框架。
RHEA: Reliability-Harmonized Reconstruction and Assignment for Robust Multimodal-Attributed Graph Clustering

- 根据节点邻域一致性自动估计各模态可靠性
- 在四种基准上,属性越差效果越优,最高提升12.3% NMI
- 适合处理图像缺失、文本嘈杂等真实场景的图聚类任务
多模态属性图(MAG)在无标签实体分组任务中至关重要,但现有方法在属性缺失或噪声环境下性能显著下降,因其假设所有节点的模态可靠性相同。实际上,不同节点的模态可靠性存在差异:图像可能损坏或缺失,文本可能不完整或嘈杂。本文提出RHEA,基于属性同质性假设,利用邻域一致性实现无需监督的节点级模态可靠性估计,并将其贯穿于重建、融合与聚类全过程。RHEA从邻域重构不可靠或缺失的模态,自适应加权多模态信息,结合可靠性感知的最优传输聚类与邻域共识分配蒸馏。同时,重构表示的置信度被引入聚类目标函数,使不确定性重构按比例参与优化。在四个MAG基准和五种属性条件下实验表明,RHEA持续优于最强基线,属性质量越差,增益越大,最大NMI提升达12.3%。
原文摘要 · Abstract (English)
Multimodal-attributed graphs (MAGs), whose nodes carry heterogeneous attributes such as text and images over a relational structure, have become a fundamental substrate for label-free entity grouping tasks, including community discovery and product segmentation. Existing MAG clustering methods effectively integrate complementary modalities when attributes are clean and complete, but degrade substantially under noisy or missing attributes because they implicitly assume equal modality reliability across all nodes. In practice, modality reliability is inherently node-specific: images may be corrupted or absent, while textual descriptions are incomplete or noisy. We argue that, under attribute homophily, graph neighborhoods naturally provide supervision-free evidence for estimating node-specific modality reliability. Based on this insight, we propose RHEA, a reliability-aware framework for MAG clustering that estimates node-specific modality reliability from neighborhood consensus and propagates this signal throughout the clustering pipeline. RHEA reconstructs unreliable or missing modalities from graph neighborhoods, adaptively weights modalities during reliability-aware fusion, and performs topology-aware optimal transport clustering with reliability-aware transport assignment and neighbor-consensus assignment distillation. Furthermore, the confidence of reconstructed representations is incorporated into the clustering objective, allowing uncertain reconstructions to contribute proportionally during optimization. Experiments on four MAG benchmarks under five attribute conditions show that RHEA consistently outperforms the strongest baseline, with NMI gains increasing as attribute quality deteriorates.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。