用大模型当外部服务,提升联邦序列推荐的精度与隐私保护
FELLAS: Enhancing Federated Sequential Recommendation with LLM as External Services
- 将大模型作为外部服务,为推荐系统提供文本增强的项目和序列表示
- 通过差分隐私扰动保护用户序列隐私,同时保留有效信息用于学习
- 适合关注隐私安全的推荐系统研究者,尤其在资源受限场景下
联邦序列推荐(FedSeqRec)因其保护用户隐私的能力而受到关注,但其性能仍不理想,主要受限于客户端设备计算资源和通信带宽,导致模型必须轻量化。本文提出通用框架FELLAS,利用大语言模型(LLM)作为外部服务来增强推荐效果。中央服务器调用LLM获取项目级文本表示,以丰富仅基于ID的嵌入;客户端则通过差分隐私保障的序列扰动技术,将序列发送至外部LLM服务器获取序列级表示。为缓解噪声表示带来的影响,设计对比学习方法,实现从噪声序列表示中迁移知识。此外,提出两种交互式物品推断攻击以验证隐私保护能力。在三个数据集上使用两种主流序列推荐模型进行的大量实验表明,FELLAS显著提升了推荐性能,并具备强隐私保护能力。
原文摘要 · Abstract (English)
Federated sequential recommendation (FedSeqRec) has gained growing attention due to its ability to protect user privacy. Unfortunately, the performance of FedSeqRec is still unsatisfactory because the models used in FedSeqRec have to be lightweight to accommodate communication bandwidth and clients' on-device computational resource constraints. Recently, large language models (LLMs) have exhibited strong transferable and generalized language understanding abilities and therefore, in the NLP area, many downstream tasks now utilize LLMs as a service to achieve superior performance without constructing complex models. Inspired by this successful practice, we propose a generic FedSeqRec framework, FELLAS, which aims to enhance FedSeqRec by utilizing LLMs as an external service. Specifically, FELLAS employs an LLM server to provide both item-level and sequence-level representation assistance. The item-level representation service is queried by the central server to enrich the original ID-based item embedding with textual information, while the sequence-level representation service is accessed by each client. However, invoking the sequence-level representation service requires clients to send sequences to the external LLM server. To safeguard privacy, we implement dx-privacy satisfied sequence perturbation, which protects clients' sensitive data with guarantees. Additionally, a contrastive learning-based method is designed to transfer knowledge from the noisy sequence representation to clients' sequential recommendation models. Furthermore, to empirically validate the privacy protection capability of FELLAS, we propose two interacted item inference attacks. Extensive experiments conducted on three datasets with two widely used sequential recommendation models demonstrate the effectiveness and privacy-preserving capability of FELLAS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。