提出首个针对图提示学习的差分隐私方法,解决敏感数据泄露问题。
DP-GPL: Differentially Private Graph Prompt Learning
- 基于PATE框架设计差分隐私图提示学习方法,保障隐私
- 在多种GNN架构下实现强隐私与高性能平衡
- 适合关注图神经网络隐私安全的研究者和应用开发者
图神经网络(GNN)在众多应用中表现出色。近期,受语言和视觉基础模型启发,图提示学习作为一种新兴的GNN训练范式出现:先在公开数据上预训练GNN,再用轻量级图提示适配敏感任务。然而,使用敏感数据生成的提示存在严重隐私风险。本文首次通过实例化成员推断攻击,揭示了图提示中的显著隐私泄露问题。同时发现,标准差分隐私方法DP-SGD在图提示学习中难以提供实用的隐私-效用权衡,可能因用于学习提示的敏感数据点过少所致。为此,我们提出DP-GPL,基于PATE框架实现具有差分隐私保证的图提示学习。在多种图提示学习方法、GNN架构和预训练策略上的评估表明,该方法在强隐私保护下仍保持高实用性,有效缓解隐私担忧,同时保留提示GNN作为图领域强大基础模型的能力。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have shown remarkable performance in various applications. Recently, graph prompt learning has emerged as a powerful GNN training paradigm, inspired by advances in language and vision foundation models. Here, a GNN is pre-trained on public data and then adapted to sensitive tasks using lightweight graph prompts. However, using prompts from sensitive data poses privacy risks. In this work, we are the first to investigate these practical risks in graph prompts by instantiating a membership inference attack that reveals significant privacy leakage. We also find that the standard privacy method, DP-SGD, fails to provide practical privacy-utility trade-offs in graph prompt learning, likely due to the small number of sensitive data points used to learn the prompts. As a solution, we propose DP-GPL for differentially private graph prompt learning based on the PATE framework, that generates a graph prompt with differential privacy guarantees. Our evaluation across various graph prompt learning methods, GNN architectures, and pre-training strategies demonstrates that our algorithm achieves high utility at strong privacy, effectively mitigating privacy concerns while preserving the powerful capabilities of prompted GNNs as powerful foundation models in the graph domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。