自动组合不同图神经网络,提升模型适应性与性能
Self-Adaptive Graph Mixture of Models
- 基于图结构动态选择并融合多个GNN模型
- 在16个数据集上超越或匹配主流GNN方法
- 支持高效训练,适合实际部署场景
图神经网络(GNN)在图结构数据学习中表现强大,但近期性能提升已趋于瓶颈。许多经典模型如GCN和GAT在调优后可媲美甚至超越更复杂的先进架构。这暴露了当前关键问题:难以为特定图任务选择最优模型。为此,我们提出自适应图混合专家模型(SAGMM),一种模块化且实用的框架,能自动从多样化架构池中选择并组合最合适的GNN模型。不同于以往依赖单一基模型变体的混合专家方法,SAGMM利用架构多样性与拓扑感知注意力门控机制,根据输入图结构为每个节点动态分配专家。为提升效率,SAGMM引入剪枝机制,在训练与推理中减少活跃专家数量而不损失性能。我们还探索了一种训练高效的变体:专家模型预训练并冻结,仅训练门控与任务层。在16个涵盖节点分类、图分类、回归和链接预测的基准数据集上评估,SAGMM始终优于或匹配领先GNN基线与先前混合方法,提供了一种鲁棒且自适应的现实图学习解决方案。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have emerged as powerful tools for learning over graph-structured data, yet recent studies have shown that their performance gains are beginning to plateau. In many cases, well-established models such as GCN and GAT, when appropriately tuned, can match or even exceed the performance of more complex, state-of-the-art architectures. This trend highlights a key limitation in the current landscape: the difficulty of selecting the most suitable model for a given graph task or dataset. To address this, we propose Self-Adaptive Graph Mixture of Models (SAGMM), a modular and practical framework that learns to automatically select and combine the most appropriate GNN models from a diverse pool of architectures. Unlike prior mixture-of-experts approaches that rely on variations of a single base model, SAGMM leverages architectural diversity and a topology-aware attention gating mechanism to adaptively assign experts to each node based on the structure of the input graph. To improve efficiency, SAGMM includes a pruning mechanism that reduces the number of active experts during training and inference without compromising performance. We also explore a training-efficient variant in which expert models are pretrained and frozen, and only the gating and task-specific layers are trained. We evaluate SAGMM on 16 benchmark datasets covering node classification, graph classification, regression, and link prediction tasks, and demonstrate that it consistently outperforms or matches leading GNN baselines and prior mixture-based methods, offering a robust and adaptive solution for real-world graph learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。