不靠消息传递,用MLP隐式建模图结构,提升模型鲁棒性。
Learning to Model Graph Structural Information on MLPs via Graph Structure Self-Contrasting
- 通过结构稀疏化和自对比学习,让MLP隐式利用图结构信息
- 在多个数据集上表现优于主流GNN,且对噪声更鲁棒
- 适合追求高效、稳定图学习的场景,尤其在噪声数据中
近年来图神经网络(GNN)在图任务中取得显著进展,但多数GNN依赖消息传递进行特征聚合与变换,使结构信息在每一层都与节点特征耦合,导致细微特征噪声或结构扰动引发严重误差传播,鲁棒性差。本文重新思考图结构信息在训练中的作用,发现消息传递并非建模结构信息的唯一路径。为此,提出无需消息传递的图结构自对比(GSSC)框架,仅基于多层感知机(MLPs),将结构信息作为先验知识隐式引导监督信号计算,替代传统显式消息传播。具体地,先对邻域进行结构稀疏化以剔除冗余或噪声边,再在稀疏邻域内执行结构自对比学习,以获得鲁棒的节点表示。最终,结构稀疏化与自对比被统一建模为双层优化问题,在端到端框架中求解。大量实验证明,GSSC在定性和定量层面均表现出色,性能超越现有领先方法,且具备更强泛化能力与鲁棒性。
原文摘要 · Abstract (English)
Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on message passing to perform feature aggregation and transformation, where the structural information is explicitly involved in the forward propagation by coupling with node features through graph convolution at each layer. As a result, subtle feature noise or structure perturbation may cause severe error propagation, resulting in extremely poor robustness. In this paper, we rethink the roles played by graph structural information in graph data training and identify that message passing is not the only path to modeling structural information. Inspired by this, we propose a simple but effective Graph Structure Self-Contrasting (GSSC) framework that learns graph structural information without message passing. The proposed framework is based purely on Multi-Layer Perceptrons (MLPs), where the structural information is only implicitly incorporated as prior knowledge to guide the computation of supervision signals, substituting the explicit message propagation as in GNNs. Specifically, it first applies structural sparsification to remove potentially uninformative or noisy edges in the neighborhood, and then performs structural self-contrasting in the sparsified neighborhood to learn robust node representations. Finally, structural sparsification and self-contrasting are formulated as a bi-level optimization problem and solved in a unified framework. Extensive experiments have qualitatively and quantitatively demonstrated that the GSSC framework can produce truly encouraging performance with better generalization and robustness than other leading competitors.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。