arXiv:2601.23239stat.MLcs.IT2026-01

提出针对含噪图的节点回归注意力模型,理论证明其优于传统方法。

Graph Attention Network for Node Regression on Random Geometric Graphs with Erdős--Rényi contamination

  • 设计任务特化的图注意力网络,用邻域统计构建去噪代理特征
  • 理论证明其回归系数估计误差更低,且对未标注节点预测更准
  • 适合处理含随机几何图与独立噪声边的复杂图数据

图注意力网络(GAT)虽常被用于图学习并表现出对节点协变量和边噪声的鲁棒性,但对其相比非注意力图神经网络(GNN)的可证明优势缺乏严谨统计分析。本文针对同时存在协变量和边污染的图基误差变量模型下的节点回归问题,提出并分析了一种专为该任务设计的图注意力网络:响应由潜在节点协变量生成,但仅观测到受噪声干扰的版本;样本图基于节点协变量构建为随机几何图,但掺杂了独立的埃爾德什-雷尼(Erdős--Rényi)边。所提方法通过邻域统计构造去噪代理特征进行回归。理论证明,在温和增长条件下,该方法在(a)估计回归系数时比基于噪声协变量的普通最小二乘法(OLS)误差更低,以及(b)对未标注节点进行响应预测时,优于朴素图卷积网络(GCN)。分析依赖于高维几何尾部界与邻域计数及样本协方差的集中性。实验验证了理论结果,包括在合成数据上的表现,以及在真实图数据上多个节点回归任务中注意力机制的有效性。

原文摘要 · Abstract (English)

Graph attention networks (GATs) are widely used and often appear robust to noise in node covariates and edges, yet rigorous statistical guarantees demonstrating a provable advantage of GATs over non-attention graph neural networks~(GNNs) are scarce. We partially address this gap for node regression with graph-based errors-in-variables models under simultaneous covariate and edge corruption: responses are generated from latent node-level covariates, but only noise-perturbed versions of the latent covariates are observed; and the sample graph is a random geometric graph created from the node covariates but contaminated by independent Erdős--Rényi edges. We propose and analyze a carefully designed, task-specific GAT that constructs denoised proxy features for regression. We prove that regressing the response variables on the proxies achieves lower error asymptotically in (a) estimating the regression coefficient compared to the ordinary least squares (OLS) estimator on the noisy node covariates, and (b) predicting the response for an unlabelled node compared to a vanilla graph convolutional network~(GCN) -- under mild growth conditions. Our analysis leverages high-dimensional geometric tail bounds and concentration for neighbourhood counts and sample covariances. We verify our theoretical findings through experiments on synthetically generated data. We also perform experiments on real-world graphs and demonstrate the effectiveness of the attention mechanism in several node regression tasks.

图神经网络注意力机制节点回归去噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。