arXiv:2410.01272cs.CRcs.LG2024-10

提出首个GNN后门净化方法,可高效清除模型中的恶意触发器。

"No Matter What You Do": Purifying GNN Models via Backdoor Unlearning

  • 通过解释方法定位图数据中的恶意触发点
  • 仅用1%干净数据将攻击成功率降至10%
  • 保留模型性能,适合部署在真实场景的GNN系统

近期研究揭示图神经网络(GNN)易受多种对抗攻击,其中后门攻击尤为棘手。与深度神经网络类似,攻击者通过在部分图数据中嵌入触发器,使模型在训练中学习到该特征。尽管已有大量针对DNN的防御工作,但针对GNN的后门防御仍严重不足,制约了GNN在实际任务中的应用。为此,我们提出GCleaner,首个针对GNN的后门缓解方法。GCleaner通过逆向后门学习过程,恢复模型性能至直接使用原始干净数据训练的水平。核心思路是:如何恢复通用且难以察觉的后门触发器?如何在不损害模型性能的前提下消除后门特征?我们利用解释方法识别最优触发位置,通过最大相似性搜索特征空间中的通用后门触发器;随后引入结合知识蒸馏与基于梯度的可解释知识的后门去学习机制,实现细粒度清除。在四个基准数据集上的实验表明,仅需1%干净数据,GCleaner即可将后门攻击成功率降至10%,且对模型性能影响极小,显著优于现有最先进防御方法。

原文摘要 · Abstract (English)

Recent studies have exposed that GNNs are vulnerable to several adversarial attacks, among which backdoor attack is one of the toughest. Similar to Deep Neural Networks (DNNs), backdoor attacks in GNNs lie in the fact that the attacker modifies a portion of graph data by embedding triggers and enforces the model to learn the trigger feature during the model training process. Despite the massive prior backdoor defense works on DNNs, defending against backdoor attacks in GNNs is largely unexplored, severely hindering the widespread application of GNNs in real-world tasks. To bridge this gap, we present GCleaner, the first backdoor mitigation method on GNNs. GCleaner can mitigate the presence of the backdoor logic within backdoored GNNs by reversing the backdoor learning procedure, aiming to restore the model performance to a level similar to that is directly trained on the original clean dataset. To achieve this objective, we ask: How to recover universal and hard backdoor triggers in GNNs? How to unlearn the backdoor trigger feature while maintaining the model performance? We conduct the graph trigger recovery via the explanation method to identify optimal trigger locations, facilitating the search of universal and hard backdoor triggers in the feature space of the backdoored model through maximal similarity. Subsequently, we introduce the backdoor unlearning mechanism, which combines knowledge distillation and gradient-based explainable knowledge for fine-grained backdoor erasure. Extensive experimental evaluations on four benchmark datasets demonstrate that GCleaner can reduce the backdoor attack success rate to 10% with only 1% of clean data, and has almost negligible degradation in model performance, which far outperforms the state-of-the-art (SOTA) defense methods.

GNN安全后门防御知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。