arXiv:2409.07773cs.IR2024-09被引 16

让用户在保护隐私前提下共享数据,提升联邦推荐系统性能。

PDC-FRS: Privacy-preserving Data Contribution for Federated Recommender System

  • 用户以差分隐私方式共享数据,生成扰动数据用于辅助训练。
  • 通过并行训练辅助模型,增强本地数据并融合全局信息。
  • 在两个公开数据集上验证,显著优于传统联邦推荐方法。

联邦推荐系统(FedRecs)已成为保护设备端推荐中用户隐私的热门研究方向。在 FedRecs 中,用户本地保留数据,仅上传模型参数以参与训练。然而,这种机制虽保护了原始数据,却因用户行为数据呈幂律分布,导致个体数据稀疏,上传参数偏离最优;且本地参数缺乏全局协同信息,仅依赖如 FedAvg 等聚合方法难以有效融合全局信息,严重制约模型性能。为此,本文提出新型联邦推荐框架 PDC-FRS,设计一种隐私保护的数据贡献机制,使用户可在差分隐私保障下共享其数据。基于共享但已扰动的数据,构建并行辅助模型,增强各用户本地数据集并整合全局协同信息。实验在两个常用推荐数据集上进行,结果表明 PDC-FRS 显著优于基线方法。

原文摘要 · Abstract (English)

Federated recommender systems (FedRecs) have emerged as a popular research direction for protecting users' privacy in on-device recommendations. In FedRecs, users keep their data locally and only contribute their local collaborative information by uploading model parameters to a central server. While this rigid framework protects users' raw data during training, it severely compromises the recommendation model's performance due to the following reasons: (1) Due to the power law distribution nature of user behavior data, individual users have few data points to train a recommendation model, resulting in uploaded model updates that may be far from optimal; (2) As each user's uploaded parameters are learned from local data, which lacks global collaborative information, relying solely on parameter aggregation methods such as FedAvg to fuse global collaborative information may be suboptimal. To bridge this performance gap, we propose a novel federated recommendation framework, PDC-FRS. Specifically, we design a privacy-preserving data contribution mechanism that allows users to share their data with a differential privacy guarantee. Based on the shared but perturbed data, an auxiliary model is trained in parallel with the original federated recommendation process. This auxiliary model enhances FedRec by augmenting each user's local dataset and integrating global collaborative information. To demonstrate the effectiveness of PDC-FRS, we conduct extensive experiments on two widely used recommendation datasets. The empirical results showcase the superiority of PDC-FRS compared to baseline methods.

联邦学习推荐系统差分隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。