用大模型语义知识引导联邦图推荐,提升跨客户端协作效果
Guiding Federated Graph Recommendation with LLM-encoded knowledge

- 通过冻结的大模型将用户行为总结为语义向量,实现跨客户端语义对齐
- 在多个基准数据集上,推荐准确率显著优于现有联邦图学习方法
- 适合关注隐私保护下个性化推荐的从业者和研究者
基于图的推荐系统能有效挖掘用户-物品交互中的协同信号,而联邦学习可在保护用户隐私的前提下训练这些模型。然而,在分布异构、非独立同分布的客户端之间聚合图表示仍具挑战:本地学习的结构嵌入常出现错位,简单的平均策略难以捕捉有意义的跨客户端关系。现有大多数联邦图方法仅依赖结构聚合,忽视了大型语言模型中蕴含的丰富全局语义信息。本文提出一种新框架,利用大模型编码的知识指导联邦图推荐。具体而言,客户端从本地图中学习结构表示,同时通过一个冻结的大模型将典型交互模式压缩为紧凑的语义向量。中心服务器利用这些大模型编码的语义信号,发现客户端间的相关偏好模式,并据此引导结构表示的有选择性聚合。这实现了无需暴露原始数据的语义驱动跨客户端协作。在标准基准上的大量实验表明,以大模型语义知识引导结构对齐,可持续提升推荐精度,优于现有联邦图基线方法。
原文摘要 · Abstract (English)
Graph-based recommender systems are highly effective at extracting collaborative signals from user--item interactions, and federated learning (FL) allows these models to be trained while preserving user privacy. However, aggregating graph representations across distributed, non-IID clients remains a challenge; structural embeddings learned locally often misalign, and naive averaging fails to capture meaningful cross-client relationships. Most existing federated graph methods rely exclusively on structural aggregation, neglecting the rich, global semantic context available in large language models (LLMs). In this paper, we propose a novel framework that uses LLM-encoded knowledge to guide federated graph recommendation. Specifically, clients learn structural representations from local graphs while simultaneously summarizing their typical interaction patterns into compact semantic vectors via a frozen LLM. The central server then uses these LLM-encoded semantic signals to discover related preference patterns across clients, guiding the selective aggregation of their structural representations. This enables semantically informed cross-client collaboration without exposing raw data. Extensive experiments on standard benchmarks show that guiding structural alignment with LLM-encoded knowledge consistently improves recommendation accuracy over existing federated graph baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。