arXiv:2603.11503cs.LG2026-03中稿 · the ACM Web Confer…被引 1

提出新框架提升联邦推荐中物品嵌入的泛化能力

Sharpness-Aware Minimization for Generalized Embedding Learning in Federated Recommendation

  • 从物品中心视角重构联邦推荐,视为多任务学习
  • 引入尖锐度感知优化,显著提升推荐性能
  • 适合关注隐私保护下推荐系统泛化能力的研究者

联邦推荐系统可在保护用户交互数据隐私的同时实现模型协同训练,仅共享关键参数。然而,现有方法忽视了在联邦推荐训练过程中稳定学习通用物品嵌入这一关键问题。物品嵌入在客户端间知识共享中起核心作用,但在跨设备场景下,本地数据分布存在显著异构性与稀疏性,加剧了通用嵌入学习的难度。为此,我们提出新的联邦推荐框架FedRecGEL,将联邦推荐问题从物品中心视角重构为多任务学习问题,旨在整个训练过程中学习通用嵌入。基于理论分析,采用尖锐度感知最小化(Sharpness-Aware Minimization)解决泛化问题,稳定训练过程并提升推荐性能。在四个数据集上的大量实验表明,FedRecGEL能显著改善联邦推荐效果。代码已开源:https://github.com/anonymifish/FedRecGEL。

原文摘要 · Abstract (English)

Federated recommender systems enable collaborative model training while keeping user interaction data local and sharing only essential model parameters, thereby mitigating privacy risks. However, existing methods overlook a critical issue, i.e., the stable learning of a generalized item embedding throughout the federated recommender system training process. Item embedding plays a central role in facilitating knowledge sharing across clients. Yet, under the cross-device setting, local data distributions exhibit significant heterogeneity and sparsity, exacerbating the difficulty of learning generalized embeddings. These factors make the stable learning of generalized item embeddings both indispensable for effective federated recommendation and inherently difficult to achieve. To fill this gap, we propose a new federated recommendation framework, named Federated Recommendation with Generalized Embedding Learning (FedRecGEL). We reformulate the federated recommendation problem from an item-centered perspective and cast it as a multi-task learning problem, aiming to learn generalized embeddings throughout the training procedure. Based on theoretical analysis, we employ sharpness-aware minimization to address the generalization problem, thereby stabilizing the training process and enhancing recommendation performance. Extensive experiments on four datasets demonstrate the effectiveness of FedRecGEL in significantly improving federated recommendation performance. Our code is available at https://github.com/anonymifish/FedRecGEL.

联邦学习推荐系统嵌入学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。