arXiv:2608.04255cs.CRcs.LG2026-08

提出隐私保护动态图推理框架,兼顾准确与低隐私损耗。

PriDyG: Privacy-preserving Dynamic Graph Inference with LLM-GNN Collaboration

  • 结合GNN与LLM,分步处理新边,实现增量隐私保护。
  • 相同隐私预算下性能优于衰减分配基线,且隐私成本降3个数量级。
  • 利用节点文本生成预测,不增加边隐私风险,适合敏感数据场景。

基于关系数据的图推理可能暴露敏感边信息,这一风险在动态图中更为严重,因模型反复更新导致隐私泄露累积。本文定义了边级差分隐私动态图推理(EDG),提出PriDyG框架,融合基于GNN的结构学习与基于LLM的语义推理。PriDyG引入增量私有多跳聚合机制,缓冲新增边并仅处理一次,通过并行组合使总隐私开销等同于单次静态发布,与更新次数或频率无关。相比几何衰减预算分配,该方法避免噪声指数增长,同时保留精确的一跳信号及至少一半的二跳信息传递。此外,PriDyG通过仅依赖节点文本的LLM预测补充私有化GNN输出,不增加额外边级隐私成本。在四个节点分类与链接预测基准上实验表明,PriDyG在相同隐私预算下持续优于几何衰减基线,且性能接近每次更新重新训练的无隐私方案,但累计隐私成本降低达三个数量级。

原文摘要 · Abstract (English)

Graph inference over relational data can expose sensitive edge information, and this risk becomes more severe in dynamic graphs, where repeated model updates cause privacy loss to accumulate. We formulate Edge-level Differentially Private Dynamic Graph Inference (EDG) and propose PriDyG, a private inference framework that combines GNN-based structural learning with LLM-based semantic reasoning. PriDyG introduces incremental private multi-hop aggregation, which buffers newly arrived edges and processes each edge exactly once. By parallel composition, the total privacy cost equals that of a single static release, independent of the number or schedule of model updates. Compared with geometrically decaying budget allocation, incremental aggregation avoids exponentially increasing noise while preserving exact one-hop signals and at least half of two-hop information transfers. PriDyG further complements privatized GNN outputs with LLM predictions derived solely from node text, incurring no additional edge-level privacy cost. Experiments on four benchmarks for node classification and link prediction show that PriDyG consistently outperforms geometrically decaying baselines under the same privacy budget and matches the utility of naive per-update retraining while reducing cumulative privacy cost by up to three orders of magnitude.

图神经网络差分隐私动态图LLM融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。