用联邦学习保护隐私,融合图文和长短时兴趣做新闻推荐
Privacy-Preserving Multimodal News Recommendation through Federated Learning
- 通过多模态模型融合新闻的文本与图像特征
- 时间感知注意力机制平衡用户长短期兴趣,提升推荐准确率
- 联邦学习框架实现数据不共享的协同训练,适合重视隐私的推荐场景
个性化新闻推荐系统(PNR)通过预测并推荐符合用户兴趣的内容来应对信息过载。然而,传统系统存在过度依赖文本内容、忽视短期兴趣、以及因集中存储用户数据引发的严重隐私问题。本文提出一种基于联邦学习的多模态新闻推荐方法,首先利用多模态模型融合新闻的文本与视觉特征,实现更全面的内容表征;其次采用时间感知模型,通过多头自注意力网络平衡用户的长期与短期兴趣,提升推荐精度;最后引入联邦学习框架,在不共享用户数据的前提下实现模型协同训练。该框架将推荐模型分为由服务器维护的大规模新闻模型与客户端共享的轻量级用户模型:客户端从服务器获取新闻表示向量与用户模型,基于本地数据计算梯度,并将本地梯度上传至服务器进行聚合;服务器通过聚合更新全局用户模型与新闻模型,同时使用更新后的新闻模型推断新的新闻表示。为增强隐私保护,采用基于Shamir秘密共享的安全聚合算法。在真实世界新闻数据集上的实验表明,该方法性能优于现有系统,显著推进了隐私保护下的个性化新闻推荐技术。
原文摘要 · Abstract (English)
Personalized News Recommendation systems (PNR) have emerged as a solution to information overload by predicting and suggesting news items tailored to individual user interests. However, traditional PNR systems face several challenges, including an overreliance on textual content, common neglect of short-term user interests, and significant privacy concerns due to centralized data storage. This paper addresses these issues by introducing a novel multimodal federated learning-based approach for news recommendation. First, it integrates both textual and visual features of news items using a multimodal model, enabling a more comprehensive representation of content. Second, it employs a time-aware model that balances users' long-term and short-term interests through multi-head self-attention networks, improving recommendation accuracy. Finally, to enhance privacy, a federated learning framework is implemented, enabling collaborative model training without sharing user data. The framework divides the recommendation model into a large server-maintained news model and a lightweight user model shared between the server and clients. The client requests news representations (vectors) and a user model from the central server, then computes gradients with user local data, and finally sends their locally computed gradients to the server for aggregation. The central server aggregates gradients to update the global user model and news model. The updated news model is further used to infer news representation by the server. To further safeguard user privacy, a secure aggregation algorithm based on Shamir's secret sharing is employed. Experiments on a real-world news dataset demonstrate strong performance compared to existing systems, representing a significant advancement in privacy-preserving personalized news recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。