arXiv:2501.05647cs.IRcs.AI2025-01KDD被引 31

大模型与小模型协同,实现云端设备端高效推荐

Collaboration of Large Language Models and Small Recommendation Models for Device-Cloud Recommendation

  • 大模型生成候选集,小模型实时重排,分工协作提升推荐效果
  • 设备端小模型捕捉实时偏好,云端大模型提供深度语义理解
  • 适合资源受限场景,兼顾精准性与实时性,推荐系统更实用

大语言模型在推荐领域展现出卓越性能,但其难以捕捉实时用户偏好,主要受限于训练和推理成本高,且难以在设备端部署。小推荐模型(SRM)则能以极低资源消耗频繁训练和推理,并便捷获取设备端实时数据。为此,我们提出设备-云协同的LLM-SRM推荐框架(LSC4Rec),融合大模型与小模型优势,以及云边计算协同效应。通过三种策略增强实用性:协同训练中,大模型生成候选列表以提升小模型排序能力并使其自适应更新;协同推理中,大模型在云端生成候选与初始排序,小模型在设备端基于候选列表进行重排,最终结果融合两者得分;设备端通过比较大模型与小模型排序一致性,判断是否需请求新候选列表。大量实验验证了各策略的有效性。

原文摘要 · Abstract (English)

Large Language Models (LLMs) for Recommendation (LLM4Rec) is a promising research direction that has demonstrated exceptional performance in this field. However, its inability to capture real-time user preferences greatly limits the practical application of LLM4Rec because (i) LLMs are costly to train and infer frequently, and (ii) LLMs struggle to access real-time data (its large number of parameters poses an obstacle to deployment on devices). Fortunately, small recommendation models (SRMs) can effectively supplement these shortcomings of LLM4Rec diagrams by consuming minimal resources for frequent training and inference, and by conveniently accessing real-time data on devices. In light of this, we designed the Device-Cloud LLM-SRM Collaborative Recommendation Framework (LSC4Rec) under a device-cloud collaboration setting. LSC4Rec aims to integrate the advantages of both LLMs and SRMs, as well as the benefits of cloud and edge computing, achieving a complementary synergy. We enhance the practicability of LSC4Rec by designing three strategies: collaborative training, collaborative inference, and intelligent request. During training, LLM generates candidate lists to enhance the ranking ability of SRM in collaborative scenarios and enables SRM to update adaptively to capture real-time user interests. During inference, LLM and SRM are deployed on the cloud and on the device, respectively. LLM generates candidate lists and initial ranking results based on user behavior, and SRM get reranking results based on the candidate list, with final results integrating both LLM's and SRM's scores. The device determines whether a new candidate list is needed by comparing the consistency of the LLM's and SRM's sorted lists. Our comprehensive and extensive experimental analysis validates the effectiveness of each strategy in LSC4Rec.

推荐系统大模型协同推理边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。