arXiv:2411.01540cs.IRcs.LG2024-11被引 17

提出高效隐私保护的联邦推荐框架,解决通信与安全难题

Efficient and Robust Regularized Federated Recommendation

  • 将推荐问题转为凸优化,确保全局最优收敛
  • 新方法通信效率提升,隐私泄露风险显著降低
  • 适合注重隐私与效率的工业级推荐系统应用

推荐系统在实际场景中至关重要,具备强大的用户偏好建模能力。然而,主流集中式学习模式引发严重隐私担忧。联邦推荐系统(FedRS)通过在客户端更新模型、由服务器协调训练而无需访问私有数据来应对这一问题。现有方法仍面临非凸优化、脆弱性、潜在隐私泄露和通信低效等挑战。本文将联邦推荐问题重新表述为凸优化问题,确保收敛至全局最优。基于此,提出新方法RFRec以高效求解该优化问题;进一步设计更高效的RFRecF,引入非均匀随机梯度下降提升通信效率。二者均在联邦学习框架下协同学习用户的共性与个性化兴趣。实验在四个基准数据集上验证,两方法在通信效率、鲁棒性和隐私保护方面均显著优于多种基线。

原文摘要 · Abstract (English)

Recommender systems play a pivotal role across practical scenarios, showcasing remarkable capabilities in user preference modeling. However, the centralized learning paradigm predominantly used raises serious privacy concerns. The federated recommender system (FedRS) addresses this by updating models on clients, while a central server orchestrates training without accessing private data. Existing FedRS approaches, however, face unresolved challenges, including non-convex optimization, vulnerability, potential privacy leakage risk, and communication inefficiency. This paper addresses these challenges by reformulating the federated recommendation problem as a convex optimization issue, ensuring convergence to the global optimum. Based on this, we devise a novel method, RFRec, to tackle this optimization problem efficiently. In addition, we propose RFRecF, a highly efficient version that incorporates non-uniform stochastic gradient descent to improve communication efficiency. In user preference modeling, both methods learn local and global models, collaboratively learning users' common and personalized interests under the federated learning setting. Moreover, both methods significantly enhance communication efficiency, robustness, and privacy protection, with theoretical support. Comprehensive evaluations on four benchmark datasets demonstrate RFRec and RFRecF's superior performance compared to diverse baselines.

联邦学习推荐系统隐私保护优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。