arXiv:2412.18886cs.LG2024-12被引 3

提出图子空间能量概念,提升GNN对拓扑攻击的鲁棒性。

Adversarial Training for Graph Neural Networks via Graph Subspace Energy Optimization

  • 用图子空间能量衡量图稳定性,指导对抗训练
  • 在多种异质与同质数据集上,对抗准确率全面领先
  • 不仅抗攻击强,原始数据上的准确率也更高

尽管图神经网络在结构化数据学习中表现出色,但在训练和推理阶段仍易受拓扑扰动攻击。虽然对抗训练在图像分类中效果显著,但其在图神经网络中的适用性曾受质疑。近期研究将重点从归纳式学习转向直推式学习,但归纳设置下的鲁棒性仍待深入探索。为此,本文提出图子空间能量(GSE)——图能量的推广形式,用于衡量邻接矩阵的稳定性,作为评估图神经网络对拓扑扰动鲁棒性的指标。基于此,提出AT-GSE方法,通过最大化GSE正则项生成扰动图进行对抗训练。针对局部与全局拓扑扰动,分别采用随机SVD(RndSVD)和Nyström低秩近似以优化GSE项。大量实验表明,AT-GSE在不同同质性与异质性数据集上均显著优于现有最先进方法,在对抗准确率方面持续领先;更令人意外的是,其在未扰动图上的干净准确率也表现更优。

原文摘要 · Abstract (English)

Despite impressive capability in learning over graph-structured data, graph neural networks (GNN) suffer from adversarial topology perturbation in both training and inference phases. While adversarial training has demonstrated remarkable effectiveness in image classification tasks, its suitability for GNN models has been doubted until a recent advance that shifts the focus from transductive to inductive learning. Still, GNN robustness in the inductive setting is under-explored, and it calls for deeper understanding of GNN adversarial training. To this end, we propose a new concept of graph subspace energy (GSE) -- a generalization of graph energy that measures graph stability -- of the adjacency matrix, as an indicator of GNN robustness against topology perturbations. To further demonstrate the effectiveness of such concept, we propose an adversarial training method with the perturbed graphs generated by maximizing the GSE regularization term, referred to as AT-GSE. To deal with the local and global topology perturbations raised respectively by LRBCD and PRBCD, we employ randomized SVD (RndSVD) and Nystrom low-rank approximation to favor the different aspects of the GSE terms. An extensive set of experiments shows that AT-GSE outperforms consistently the state-of-the-art GNN adversarial training methods over different homophily and heterophily datasets in terms of adversarial accuracy, whilst more surprisingly achieving a superior clean accuracy on non-perturbed graphs.

图神经网络对抗训练拓扑鲁棒性图能量

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。