用预训练大模型生成用户画像,让推荐系统更懂人且不慢
Pre-trained LLMs Meet Sequential Recommenders: Efficient User-Centric Knowledge Distillation

- 用大模型生成用户文本画像,蒸馏给推荐模型
- 推理速度不变,仍保持传统模型效率
- 无需微调大模型,适合实际部署场景
序列推荐系统在建模用户行为时间序列上取得显著进展,但难以捕捉交互模式之外的丰富用户语义。大语言模型(LLMs)具备强大的推理能力,可提升用户理解,但现有融合方式在实时推理中带来高昂开销。为此,我们提出一种新型知识蒸馏方法,将预训练LLM生成的文本用户画像注入序列推荐模型,避免服务阶段的LLM推理。该方法保持传统序列模型的推理效率,无需修改模型结构,也无需对LLM进行微调。
原文摘要 · Abstract (English)
Sequential recommender systems have achieved significant success in modeling temporal user behavior but remain limited in capturing rich user semantics beyond interaction patterns. Large Language Models (LLMs) present opportunities to enhance user understanding with their reasoning capabilities, yet existing integration approaches create prohibitive inference costs in real time. To address these limitations, we present a novel knowledge distillation method that utilizes textual user profile generated by pre-trained LLMs into sequential recommenders without requiring LLM inference at serving time. The resulting approach maintains the inference efficiency of traditional sequential models while requiring neither architectural modifications nor LLM fine-tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。