arXiv:2412.02934cs.LGcs.DC2024-12被引 2

通过智能分配隐私预算,提升联邦推荐系统的准确率。

BGTplanner: Maximizing Training Accuracy for Differentially Private Federated Recommenders via Strategic Privacy Budget Allocation

  • 用高斯过程预测不同预算下的准确率变化。
  • 结合上下文多臂赌博机动态分配每轮隐私预算。
  • 在真实数据集上比顶尖方法平均提升6.76%准确率。

为缓解隐私泄露担忧,联邦推荐(FR)允许客户端在不暴露原始用户-物品评分数据的情况下协同训练推荐模型。差分隐私联邦推荐(DPFR)进一步通过向客户端注入差分隐私(DP)噪声来增强隐私保护。然而,现有DPFR因噪声失真导致准确率不理想。尽管已有研究尝试通过自适应分配隐私预算来改进,但隐私预算分配与模型准确率之间的复杂关系仍使当前方法难以最大化性能。为此,本文提出BGTplanner(预算规划器),通过策略性分配每轮训练的隐私预算,提升整体训练表现。具体而言,利用高斯过程回归和历史信息预测特定预算分配下的准确率变化;同时,采用上下文多臂赌博机(CMAB)决策机制,在当前收益与长期隐私约束间取得平衡。大量实验证明,相较于现有最优基线,BGTplanner在真实数据集上平均提升6.76%的训练性能。

原文摘要 · Abstract (English)

To mitigate the rising concern about privacy leakage, the federated recommender (FR) paradigm emerges, in which decentralized clients co-train the recommendation model without exposing their raw user-item rating data. The differentially private federated recommender (DPFR) further enhances FR by injecting differentially private (DP) noises into clients. Yet, current DPFRs, suffering from noise distortion, cannot achieve satisfactory accuracy. Various efforts have been dedicated to improving DPFRs by adaptively allocating the privacy budget over the learning process. However, due to the intricate relation between privacy budget allocation and model accuracy, existing works are still far from maximizing DPFR accuracy. To address this challenge, we develop BGTplanner (Budget Planner) to strategically allocate the privacy budget for each round of DPFR training, improving overall training performance. Specifically, we leverage the Gaussian process regression and historical information to predict the change in recommendation accuracy with a certain allocated privacy budget. Additionally, Contextual Multi-Armed Bandit (CMAB) is harnessed to make privacy budget allocation decisions by reconciling the current improvement and long-term privacy constraints. Our extensive experimental results on real datasets demonstrate that \emph{BGTplanner} achieves an average improvement of 6.76\% in training performance compared to state-of-the-art baselines.

联邦学习差分隐私推荐系统预算分配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。