arXiv:2604.14833cs.IR2026-04

用联邦学习保护隐私,让大模型跨域推荐更精准。

Federated User Behavior Modeling for Privacy-Preserving LLM Recommendation

论文配图:Federated User Behavior Modeling for Privacy-Preserving LLM Recommendation
图 1 · 摘自论文原文
  • 用自然语言作桥梁,在不共享用户数据前提下对齐跨域行为。
  • 跨域知识融合提升推荐效果,比当前最佳方法高3.2%准确率。
  • 适合关注用户隐私与跨平台推荐的工业界研究者。

大语言模型在推荐系统中表现优异,但用户数据稀疏限制了其建模能力。现有跨域推荐方法通常假设领域重叠且可直接访问数据,缺乏对隐私保护跨域推荐(PPCDR)的关注。非重叠领域的PPCDR面临三大挑战:无法跨域共享用户身份或行为数据;不同领域数据模态异构导致知识整合困难;传统协同过滤信号与大模型特征空间不兼容。为此,我们提出语义增强的联邦用户行为建模方法SF-UBM。针对第一点,采用自然语言作为通用桥梁,加密共享文本项表示,用户数据本地保留;针对第二点,设计事实-反事实知识蒸馏模块,融合领域无关与领域特定知识;针对第三点,将预训练用户偏好与跨域项表示映射到软提示空间,对齐行为与语义空间以促进大模型学习。在三组真实世界跨域场景上实验表明,SF-UBM显著优于现有最先进方法。

原文摘要 · Abstract (English)

Large Language Models have shown great success in recommender systems. However, the limited and sparse nature of user data often restricts the LLM's ability to effectively model behavior patterns. To address this, existing studies have explored cross-domain solutions by conducting Cross-Domain Recommendation tasks. But previous methods typically assume domains are overlapped and can be accessed readily. None of the LLM methods address the privacy-preserving issues in the CDR settings, that is, Privacy-Preserving Cross-Domain Recommendation. Conducting non-overlapping PPCDR with LLM is challenging since: 1)The inability to share user identity or behavioral data across domains impedes effective cross-domain alignment. 2)The heterogeneity of data modalities across domains complicates knowledge integration. 3)Fusing collaborative filtering signals from traditional recommendation models with LLMs is difficult, as they operate within distinct feature spaces. To address the above issues, we propose SF-UBM, a Semantic-enhanced Federated User Behavior Modeling method. Specifically, to deal with Challenge 1, we leverage natural language as a universal bridge to connect disjoint domains via a semantic-enhanced federated architecture. Here, text-based item representations are encrypted and shared, while user-specific data remains local. To handle Challenge 2, we design a Fact-counter Knowledge Distillation module to integrate domain-agnostic knowledge with domain-specific knowledge, across different data modalities. To tackle Challenge 3, we project pre-learned user preferences and cross-domain item representations into the soft prompt space, aligning behavioral and semantic spaces for effective LLM learning. We conduct extensive experiments on three pairs of real-world domains, and the experimental results demonstrate the effectiveness of SF-UBM compared to the recent SOTA methods.

联邦学习大模型推荐隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。