提出统一方法PerturbEmbedding,提升图神经网络抗干扰能力
Unifying Adversarial Perturbation for Graph Neural Networks
- 在图神经网络隐藏层嵌入上直接施加对抗扰动
- 在多个数据集和模型上显著增强鲁棒性与泛化能力
- 统一处理随机与对抗扰动,适用于多种图模型
本文研究图神经网络(GNNs)在节点特征和图结构上的脆弱性。现有对抗训练方法通过在节点特征、权重或图结构上施加扰动,并学习更鲁棒的模型参数来提升性能。但这些方法多局限于特定数据集和模型类型。为此,本文提出PerturbEmbedding,将对抗扰动与训练过程融合,在每个隐藏嵌入层直接施加扰动,构建统一框架,涵盖多数现有扰动策略。该方法从统一视角看待随机与对抗扰动形式。在多种数据集和骨干模型上的实验表明,PerturbEmbedding显著提升GNN的鲁棒性与泛化能力,优于现有方法。同时,对随机(非目标)和对抗(目标)扰动的双重抑制进一步提升了模型性能。
原文摘要 · Abstract (English)
This paper studies the vulnerability of Graph Neural Networks (GNNs) to adversarial attacks on node features and graph structure. Various methods have implemented adversarial training to augment graph data, aiming to bolster the robustness and generalization of GNNs. These methods typically involve applying perturbations to the node feature, weights, or graph structure and subsequently minimizing the loss by learning more robust graph model parameters under the adversarial perturbations. Despite the effectiveness of adversarial training in enhancing GNNs' robustness and generalization abilities, its application has been largely confined to specific datasets and GNN types. In this paper, we propose a novel method, PerturbEmbedding, that integrates adversarial perturbation and training, enhancing GNNs' resilience to such attacks and improving their generalization ability. PerturbEmbedding performs perturbation operations directly on every hidden embedding of GNNs and provides a unified framework for most existing perturbation strategies/methods. We also offer a unified perspective on the forms of perturbations, namely random and adversarial perturbations. Through experiments on various datasets using different backbone models, we demonstrate that PerturbEmbedding significantly improves both the robustness and generalization abilities of GNNs, outperforming existing methods. The rejection of both random (non-targeted) and adversarial (targeted) perturbations further enhances the backbone model's performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。