首次系统评估图神经网络盗取难度与防御效果,发现多数防御在实际攻击中形同虚设。
GraphIP-Bench: How Hard Is It to Steal a Graph Neural Network, and Can We Stop It?

- 构建统一基准GraphIP-Bench,涵盖12种攻击与12种防御方法
- 中等查询预算下盗取成功率超90%,多数防御无效
- 异质图更难被窃取,跨架构不匹配仍无法阻止盗取
部署在云端的图神经网络(GNN)可能遭受模型提取攻击,即通过查询响应训练代理模型以复现目标行为。现有研究难以回答“盗取有多难”和“能否阻止”两个问题,因实验使用不一致的数据集、威胁模型和评估指标。本文提出GraphIP-Bench,一个统一的基准,用于在单一黑盒协议下评估攻击与防御。该基准整合了12种提取攻击、12种防御(包括水印、输出扰动、查询模式检测)、10个公开图数据集(覆盖同质、异质及大规模场景)、3种GNN主干模型和3项图学习任务。在共享划分、查询次数与预算下报告保真度、任务效用、所有权验证与计算成本。进一步引入攻防联合赛道,对每种防御目标运行所有攻击,并测量生成代理模型上的水印验证率,揭示防御在提取后的真实保护能力。结果表明:在中等查询预算下盗取极为容易;多数防御无法改变这一局面;部分水印在原模型上有效,但在代理模型上验证信号大幅丢失,暴露单模型评估的盲区;异质图更难被窃取,而目标与代理间架构不匹配虽能降低但无法阻止提取。代码与配置已开源,集成至PyGIP库。
原文摘要 · Abstract (English)
Graph neural networks (GNNs) deployed as cloud services can be stolen through model-extraction attacks, which train a surrogate from query responses to reproduce the target's behavior, and a growing line of ownership defenses tries to prevent or trace such theft. This paper asks two questions: how hard is it to steal a GNN, and can we stop it? Prior work cannot answer either, because experiments use inconsistent datasets, threat models, and metrics. We introduce GraphIP-Bench, a unified benchmark that evaluates both sides under a single black-box protocol. GraphIP-Bench integrates twelve extraction attacks, twelve defenses spanning watermarking, output perturbation, and query-pattern detection, ten public graphs covering homophilic, heterophilic, and large-scale regimes, three GNN backbones, and three graph-learning tasks. It reports fidelity, task utility, ownership verification, and computational cost on shared splits, queries, and budgets. We further add a joint attack-and-defense track that runs every attack on every defended target and measures watermark verification on the resulting surrogate, exposing how much protection a defense retains after extraction. The empirical picture is clear: stealing a GNN is easy at medium query budgets and most defenses do not change this; several watermarks verify reliably on the protected model but lose most of their verification signal on the extracted surrogate, exposing a gap that single-model evaluations miss; and heterophilic graphs are systematically harder to steal, while a cross-architecture mismatch between target and surrogate reduces but does not prevent extraction. We release GraphIP-Bench with reproducible scripts and configurations, and integrate the attacks and defenses into the PyGIP library. Code: https://github.com/LabRAI/GraphIP-Bench. Library: https://labrai.github.io/PyGIP/index.html.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。