为关系数据设计可证明隐私保护的训练方法,保障每个实体不被泄露。
Differentially Private Relational Learning with Entity-level Privacy Guarantees
- 基于实体出现频次动态调整梯度裁剪,控制敏感度
- 在多阶段采样场景下仍保持严格差分隐私保证
- 适合医疗、社交网络等高敏感领域的关系学习
关系数据的学习在隐私敏感领域日益重要,需保障个体实体隐私。差分隐私(DP)提供量化隐私风险的理论框架,其中DP-SGD是主流私有化训练机制。但直接应用于关系学习存在两大挑战:(i) 实体常参与多个关系,导致敏感度高且难控;(ii) 关系学习通常包含多阶段、可能耦合的采样过程,标准隐私放大分析失效。本文提出一种具正式实体级差分隐私保证的关系学习框架,进行严谨的敏感度分析,引入基于实体出现频率自适应调节的梯度裁剪机制,并将隐私放大结果扩展至一类可处理的耦合采样情形(依赖仅源于样本量)。由此构建的定制化DP-SGD变体具备可证明的隐私保障。在文本属性网络结构数据上微调文本编码器的实验表明,该方法在实用性和隐私性之间取得良好平衡。代码已公开于 https://github.com/Graph-COM/Node_DP。
原文摘要 · Abstract (English)
Learning with relational and network-structured data is increasingly vital in sensitive domains where protecting the privacy of individual entities is paramount. Differential Privacy (DP) offers a principled approach for quantifying privacy risks, with DP-SGD emerging as a standard mechanism for private model training. However, directly applying DP-SGD to relational learning is challenging due to two key factors: (i) entities often participate in multiple relations, resulting in high and difficult-to-control sensitivity; and (ii) relational learning typically involves multi-stage, potentially coupled (interdependent) sampling procedures that make standard privacy amplification analyses inapplicable. This work presents a principled framework for relational learning with formal entity-level DP guarantees. We provide a rigorous sensitivity analysis and introduce an adaptive gradient clipping scheme that modulates clipping thresholds based on entity occurrence frequency. We also extend the privacy amplification results to a tractable subclass of coupled sampling, where the dependence arises only through sample sizes. These contributions lead to a tailored DP-SGD variant for relational data with provable privacy guarantees. Experiments on fine-tuning text encoders over text-attributed network-structured relational data demonstrate the strong utility-privacy trade-offs of our approach. Our code is available at https://github.com/Graph-COM/Node_DP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。