用大模型生成用户行为变体,提升隐私保护下的推荐效果
Empowering Contrastive Federated Sequential Recommendation with LLMs
- 本地调用大模型生成三类行为序列:未来延续、语义重述、反事实负例
- 在三个公开数据集上,HR@20和NDCG@20均优于主流基线
- 无需服务器额外保护模块,仍具抗噪声和对抗攻击能力
联邦序列推荐(FedSeqRec)旨在保护用户数据隐私的同时实现下一物品预测,但受限于各设备上碎片化、嘈杂且同质的交互日志。现有方法多依赖人工数据增强或服务器端约束,或缺乏语义多样性,或增加系统开销。为此,我们提出LUMOS,一种参数隔离的联邦序列推荐架构,将大语言模型(LLMs)作为本地语义生成器。不共享梯度或辅助参数,而是私有地调用设备端的LLM,从每个用户历史生成三种互补序列变体:(i) 未来导向轨迹,推断可能的行为延续;(ii) 语义等价重述,保留用户意图同时多样化交互模式;(iii) 偏好不一致的反事实负例,作为信息性负样本。这些合成序列通过三视图对比优化方案联合编码至联邦主干网络,实现更丰富的表示学习,且不暴露敏感信息。在三个公开基准上的实验表明,LUMOS在HR@20和NDCG@20上持续优于竞争性的集中式与联邦基线。此外,基于语义的正样本信号与反事实负例显著提升了在噪声和对抗环境下的鲁棒性,即便无专用服务器端防护模块亦然。整体而言,本工作展示了大模型驱动的语义生成作为隐私保护联邦推荐新范式的潜力。
原文摘要 · Abstract (English)
Federated sequential recommendation (FedSeqRec) aims to perform next-item prediction while keeping user data decentralised, yet model quality is frequently constrained by fragmented, noisy, and homogeneous interaction logs stored on individual devices. Many existing approaches attempt to compensate through manual data augmentation or additional server-side constraints, but these strategies either introduce limited semantic diversity or increase system overhead. To overcome these challenges, we propose \textbf{LUMOS}, a parameter-isolated FedSeqRec architecture that integrates large language models (LLMs) as \emph{local semantic generators}. Instead of sharing gradients or auxiliary parameters, LUMOS privately invokes an on-device LLM to construct three complementary sequence variants from each user history: (i) \emph{future-oriented} trajectories that infer plausible behavioural continuations, (ii) \emph{semantically equivalent rephrasings} that retain user intent while diversifying interaction patterns, and (iii) \emph{preference-inconsistent counterfactuals} that serve as informative negatives. These synthesized sequences are jointly encoded within the federated backbone through a tri-view contrastive optimisation scheme, enabling richer representation learning without exposing sensitive information. Experimental results across three public benchmarks show that LUMOS achieves consistent gains over competitive centralised and federated baselines on HR@20 and NDCG@20. In addition, the use of semantically grounded positive signals and counterfactual negatives improves robustness under noisy and adversarial environments, even without dedicated server-side protection modules. Overall, this work demonstrates the potential of LLM-driven semantic generation as a new paradigm for advancing privacy-preserving federated recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。