用课程学习提升GNN抗攻击能力,自动识别并优先学习常见数据模式。
Perseus: Leveraging Common Data Patterns with Curriculum Learning for More Robust Graph Neural Networks
- 基于全局同质性评估边的难易度,按难度递增顺序训练
- 在多个数据集上显著提升模型鲁棒性,对抗攻击下准确率更高
- 适合需要高可靠性的图神经网络应用场景
图神经网络(GNN)在处理图数据方面表现优异,但对对抗攻击仍显脆弱。现有防御方法通常依赖图稀疏性和同质性假设,通过预处理或引导结构学习来应对。然而,预处理方法难以准确区分正常边与对抗扰动,常导致有价值边信息丢失,效果不佳。直接在受扰图数据上训练的鲁棒模型易陷入次优局部最优,影响性能。为此,我们提出Perseus,一种基于课程学习的新型对抗防御方法。Perseus利用全局同质性评估边的难易程度,并采用课程学习策略调整学习顺序,引导模型在学习完整图结构的同时,自适应聚焦于常见数据模式,从而缓解对抗扰动的影响。实验表明,使用Perseus训练的模型在多个基准数据集上表现出更优性能和更强鲁棒性。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) excel at handling graph data but remain vulnerable to adversarial attacks. Existing defense methods typically rely on assumptions like graph sparsity and homophily to either preprocess the graph or guide structure learning. However, preprocessing methods often struggle to accurately distinguish between normal edges and adversarial perturbations, leading to suboptimal results due to the loss of valuable edge information. Robust graph neural network models train directly on graph data affected by adversarial perturbations, without preprocessing. This can cause the model to get stuck in poor local optima, negatively affecting its performance. To address these challenges, we propose Perseus, a novel adversarial defense method based on curriculum learning. Perseus assesses edge difficulty using global homophily and applies a curriculum learning strategy to adjust the learning order, guiding the model to learn the full graph structure while adaptively focusing on common data patterns. This approach mitigates the impact of adversarial perturbations. Experiments show that models trained with Perseus achieve superior performance and are significantly more robust to adversarial attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。