通过对抗训练实现图嵌入的差分隐私保护,兼顾安全与性能。
AdvSGM: Differentially Private Graph Learning via Adversarial Skip-gram Model
- 引入对抗训练机制,动态调整噪声以保护隐私
- 在6个真实图数据集上保持高下游任务性能
- 无需额外加噪,提升模型实用性和隐私保障
跳跃-词袋模型(SGM)通过神经网络生成节点向量,是众多流行图嵌入技术的基础。然而,训练数据包含敏感关联信息,释放的SGM参数可能泄露隐私,带来重大风险。差分隐私(DP)是数据隐私保护的严格标准,但将其应用于图上的跳字模型时面临挑战:复杂的边关系导致高敏感度,需注入大量噪声。为此,我们提出AdvSGM,一种基于对抗训练的图差分私有跳字模型。核心思想是利用对抗训练在不增加额外噪声的情况下实现隐私保护。我们设计了两个可优化的噪声项,分别对应跳字模型的参数,并通过调节模块间权重,实现差分私有的梯度更新。在六个真实图数据集上的实验表明,AdvSGM在不同下游任务中均保持了较高的数据效用。
原文摘要 · Abstract (English)
The skip-gram model (SGM), which employs a neural network to generate node vectors, serves as the basis for numerous popular graph embedding techniques. However, since the training datasets contain sensitive linkage information, the parameters of a released SGM may encode private information and pose significant privacy risks. Differential privacy (DP) is a rigorous standard for protecting individual privacy in data analysis. Nevertheless, when applying differential privacy to skip-gram in graphs, it becomes highly challenging due to the complex link relationships, which potentially result in high sensitivity and necessitate substantial noise injection. To tackle this challenge, we present AdvSGM, a differentially private skip-gram for graphs via adversarial training. Our core idea is to leverage adversarial training to privatize skip-gram while improving its utility. Towards this end, we develop a novel adversarial training module by devising two optimizable noise terms that correspond to the parameters of a skip-gram. By fine-tuning the weights between modules within AdvSGM, we can achieve differentially private gradient updates without additional noise injection. Extensive experimental results on six real-world graph datasets show that AdvSGM preserves high data utility across different downstream tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。