提出PLGC策略缓解联邦推荐中的嵌入退化问题,提升个性化效果。
A Model-agnostic Strategy to Mitigate Embedding Degradation in Personalized Federated Recommendation
- 将冻结的全局物品嵌入引入本地设备,通过动态平衡局部与全局信息优化表示
- 在五个真实数据集上显著优于基线模型,有效缓解维度坍缩与嵌入冗余
- 无需修改模型结构,可通用适配现有联邦推荐系统,适合隐私敏感场景
集中式推荐系统因需收集用户行为等私有数据而面临隐私泄露风险。因此,联邦推荐系统(FedRec)成为一种有前景的方法,其在服务器端聚合全局模型。然而,该分布式训练范式因稀疏交互和偏好异质性,导致个性化不足与维度坍缩,引发嵌入退化。为此,本文提出一种新型模型无关策略——个性化本地-全局协作(PLGC),首次在联邦推荐中缓解维度坍缩问题。具体地,将冻结的全局物品嵌入表引入本地设备,基于神经切线核策略动态平衡局部与全局信息,在前向推理中优化个性化表示,最终收敛至用户特定偏好。此外,PLGC引入对比目标函数,通过消除维度间依赖降低嵌入冗余,改善反向传播过程。该方法作为模型无关的个性化训练策略,可应用于现有基线以缓解嵌入退化。在五个真实世界数据集上的大量实验表明,PLGC在有效性与适应性上均表现优异,显著超越多种基线算法。
原文摘要 · Abstract (English)
Centralized recommender systems encounter privacy leakage due to the need to collect user behavior and other private data. Hence, federated recommender systems (FedRec) have become a promising approach with an aggregated global model on the server. However, this distributed training paradigm suffers from embedding degradation caused by suboptimal personalization and dimensional collapse, due to the existence of sparse interactions and heterogeneous preferences. To this end, we propose a novel model-agnostic strategy for FedRec to strengthen the personalized embedding utility, which is called Personalized Local-Global Collaboration (PLGC). It is the first research in federated recommendation to alleviate the dimensional collapse issue. Particularly, we incorporate the frozen global item embedding table into local devices. Based on a Neural Tangent Kernel strategy that dynamically balances local and global information, PLGC optimizes personalized representations during forward inference, ultimately converging to user-specific preferences. Additionally, PLGC carries on a contrastive objective function to reduce embedding redundancy by dissolving dependencies between dimensions, thereby improving the backward representation learning process. We introduce PLGC as a model-agnostic personalized training strategy for federated recommendations that can be applied to existing baselines to alleviate embedding degradation. Extensive experiments on five real-world datasets have demonstrated the effectiveness and adaptability of PLGC, which outperforms various baseline algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。