arXiv:2412.13754cs.LGmath.PR2024-12ICML被引 3

提出首个图神经网络在半监督学习中达到理论最优的条件。

Optimal Exact Recovery in Semi-Supervised Learning: A Study of Spectral Methods and Graph Convolutional Networks

论文配图:Optimal Exact Recovery in Semi-Supervised Learning: A Study of Spectral Methods and Graph Convolutional Networks
图 1 · 摘自论文原文
  • 基于主成分分析设计谱估计器,融合邻接矩阵与特征向量。
  • 图岭回归和GCN在最优自环权重下可逼近理论最优恢复精度。
  • 揭示特征学习对提升GCN性能的关键作用,适合研究半监督学习者。

我们研究了在上下文随机块模型(CSBM)数据集上的半监督节点分类问题。该模型中,来自双簇随机块模型(SBM)的节点附带由对应标签的高斯混合模型(GMM)生成的特征向量。仅部分节点标签可用于训练,目标是准确分类剩余节点。在归纳学习场景下,我们首次确定了在CSBM中实现所有测试节点精确恢复的信息论阈值。同时,我们设计了一种受主成分分析启发的最优谱估计器,利用训练标签及邻接矩阵和特征向量的必要信息。我们还评估了图岭回归和图卷积网络(GCN)在此合成数据集上的表现。结果表明,当使用最优加权自环时,图岭回归和GCN能够以与最优估计器相当的方式实现精确恢复的理论极限,凸显了特征学习在增强GCN能力方面的作用,尤其是在半监督学习中的潜力。

原文摘要 · Abstract (English)

We delve into the challenge of semi-supervised node classification on the Contextual Stochastic Block Model (CSBM) dataset. Here, nodes from the two-cluster Stochastic Block Model (SBM) are coupled with feature vectors, which are derived from a Gaussian Mixture Model (GMM) that corresponds to their respective node labels. With only a subset of the CSBM node labels accessible for training, our primary objective becomes the accurate classification of the remaining nodes. Venturing into the transductive learning landscape, we, for the first time, pinpoint the information-theoretical threshold for the exact recovery of all test nodes in CSBM. Concurrently, we design an optimal spectral estimator inspired by Principal Component Analysis (PCA) with the training labels and essential data from both the adjacency matrix and feature vectors. We also evaluate the efficacy of graph ridge regression and Graph Convolutional Networks (GCN) on this synthetic dataset. Our findings underscore that graph ridge regression and GCN possess the ability to achieve the information threshold of exact recovery in a manner akin to the optimal estimator when using the optimal weighted self-loops. This highlights the potential role of feature learning in augmenting the proficiency of GCN, especially in the realm of semi-supervised learning.

半监督学习图神经网络谱方法信息论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。