跨平台推荐新算法,保护隐私还能提升长期用户参与度。
FedSlate:A Federated Deep Reinforcement Learning Recommender System
- 用联邦强化学习融合多平台用户行为数据。
- 在跨平台场景下性能超越现有基线方法。
- 适合注重隐私、需跨平台协同的推荐系统研发者。
强化学习已被用于优化推荐系统的长期用户参与度,但现有方法未能充分挖掘用户在不同平台上的行为相关性。集中式数据聚合虽可提升效果,却带来高昂通信成本与隐私风险。为此,我们提出 FedSlate——一种联邦强化学习推荐算法,可在法律禁止共享数据的前提下有效利用跨平台信息。采用 SlateQ 算法辅助学习用户长期行为并评估推荐内容价值,将推荐系统应用范围从单用户单平台扩展至单用户多平台,并通过联邦学习应对跨平台学习挑战。使用 RecSim 构建仿真环境评估性能,实验表明,在多种环境下 FedSlate 均显著优于基线方法,且在基线方法完全失效的场景中仍能学习有效推荐策略。代码已开源。
原文摘要 · Abstract (English)
Reinforcement learning methods have been used to optimize long-term user engagement in recommendation systems. However, existing reinforcement learning-based recommendation systems do not fully exploit the relevance of individual user behavior across different platforms. One potential solution is to aggregate data from various platforms in a centralized location and use the aggregated data for training. However, this approach raises economic and legal concerns, including increased communication costs and potential threats to user privacy. To address these challenges, we propose \textbf{FedSlate}, a federated reinforcement learning recommendation algorithm that effectively utilizes information that is prohibited from being shared at a legal level. We employ the SlateQ algorithm to assist FedSlate in learning users' long-term behavior and evaluating the value of recommended content. We extend the existing application scope of recommendation systems from single-user single-platform to single-user multi-platform and address cross-platform learning challenges by introducing federated learning. We use RecSim to construct a simulation environment for evaluating FedSlate and compare its performance with state-of-the-art benchmark recommendation models. Experimental results demonstrate the superior effects of FedSlate over baseline methods in various environmental settings, and FedSlate facilitates the learning of recommendation strategies in scenarios where baseline methods are completely inapplicable. Code is available at \textit{https://github.com/TianYaDY/FedSlate}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。