用大模型提升跨域推荐,解决隐私与数据异构难题
FeDecider: An LLM-Based Framework for Federated Cross-Domain Recommendation

- 分离客户端低秩更新方向,避免局部过拟合
- 通过个性化权重融合跨域更新,提升推荐精度
- 适合需要跨域协同且保护用户隐私的场景
联邦跨域推荐(Federated CDR)旨在在保护数据隐私的前提下,跨异构领域协同学习个性化推荐模型。近期基于大语言模型(LLM)的推荐模型凭借其强大的推理能力和广泛知识,展现出优异性能。然而,在联邦跨域推荐中引入LLM带来新挑战:首先,领域特定的本地适配器存在过拟合风险,不同领域的参数更新幅度差异导致聚合偏差,使模型偏向特定领域分布;其次,与传统推荐模型(如协同过滤、双分图方法)显式学习可比的用户/物品表示不同,LLM通过自回归文本生成训练隐式编码知识,难以有效衡量异构环境下的跨域相似性。为此,我们提出基于LLM的联邦跨域推荐框架FeDecider。具体而言,FeDecider通过解耦每个客户端的低秩更新并仅共享其方向成分,缓解尺度噪声问题;同时,各客户端学习个性化权重,实现对其他领域更新的数据感知融合。在多个数据集上的实验验证了所提FeDecider的有效性。
原文摘要 · Abstract (English)
Federated cross-domain recommendation (Federated CDR) aims to collaboratively learn personalized recommendation models across heterogeneous domains while preserving data privacy. Recently, large language model (LLM)-based recommendation models have demonstrated impressive performance by leveraging LLMs' strong reasoning capabilities and broad knowledge. However, adopting LLM-based recommendation models in Federated CDR scenarios introduces new challenges. First, there exists a risk of overfitting with domain-specific local adapters. The magnitudes of locally optimized parameter updates often vary across domains, causing biased aggregation and overfitting toward domain-specific distributions. Second, unlike traditional recommendation models (e.g., collaborative filtering, bipartite graph-based methods) that learn explicit and comparable user/item representations, LLMs encode knowledge implicitly through autoregressive text generation training. This poses additional challenges for effectively measuring the cross-domain similarities under heterogeneity. To address these challenges, we propose an LLM-based framework for federated cross-domain recommendation, FeDecider. Specifically, FeDecider tackles the challenge of scale-specific noise by disentangling each client's low-rank updates and sharing only their directional components. To handle the need for flexible and effective integration, each client further learns personalized weights that achieve the data-aware integration of updates from other domains. Extensive experiments across diverse datasets validate the effectiveness of our proposed FeDecider.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。