arXiv:2411.17062cs.LGcs.AI2024-11被引 2

通过双层优化全局学习图结构,提升GNN鲁棒性

Graph Structure Learning with Bi-level Optimization

  • 用双层优化统一学习图结构与GNN参数
  • 在4个真实数据集上优于现有SOTA方法
  • 适合需要提升图神经网络泛化能力的研究者

现有图结构学习(GSL)方法多从局部视角出发,仅基于每条边的局部信息进行优化,忽视了图中节点间跨类别连接分布不均的问题。为此,本文将图结构视为可学习参数,从全局视角联合优化图结构与GNN的公共参数。其中,公共参数包含节点特征映射的全局信息,对结构优化至关重要。数学上,引入通用结构提取器,将GNN转化为结构与参数联合学习的形式,并构建新型双层优化框架——GSEBO:上层优化GNN参数以获取全局映射信息,下层利用该信息优化图结构。在经典GNN模型上实现该框架,并在4个真实世界数据集上验证其有效性,结果表明其显著优于当前主流GSL方法。

原文摘要 · Abstract (English)

Currently, most Graph Structure Learning (GSL) methods, as a means of learning graph structure, improve the robustness of GNN merely from a local view by considering the local information related to each edge and indiscriminately applying the mechanism across edges, which may suffer from the local structure heterogeneity of the graph (\ie the uneven distribution of inter-class connections over nodes). To overcome the cons, we extract the graph structure as a learnable parameter and jointly learn the structure and common parameters of GNN from the global view. Excitingly, the common parameters contain the global information for nodes features mapping, which is also crucial for structure optimization (\ie optimizing the structure relies on global mapping information). Mathematically, we apply a generic structure extractor to abstract the graph structure and transform GNNs in the form of learning structure and common parameters. Then, we model the learning process as a novel bi-level optimization, \ie \textit{Generic Structure Extraction with Bi-level Optimization for Graph Structure Learning (GSEBO)}, which optimizes GNN parameters in the upper level to obtain the global mapping information and graph structure is optimized in the lower level with the global information learned from the upper level. We instantiate the proposed GSEBO on classical GNNs and compare it with the state-of-the-art GSL methods. Extensive experiments validate the effectiveness of the proposed GSEBO on four real-world datasets.

图神经网络结构学习双层优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。