用提示词生成用户物品画像,提升推荐系统表现
A Prompting-Based Representation Learning Method for Recommendation with Large Language Models
- 通过提示词策略生成个性化物品描述
- 融合BERT语义嵌入与GCN协同过滤,对齐表示空间
- 适合关注大模型在推荐中应用的从业者
近年来,随着自然语言处理领域大语言模型(LLMs)的发展,推荐系统迎来变革。GPT-3.5/4、Llama等模型展现出卓越的文本理解与生成能力,其预训练的丰富信息为捕捉用户与物品的深层语义表示提供了可能。然而,如何有效利用上下文信息中的用户-物品偏好,并推动推荐系统性能提升仍面临挑战。本文认为,深入理解用户或物品本身是提升推荐效果的关键,因此研究基于先进LLM生成有信息量的用户/物品画像。为此提出提示词驱动的推荐表征学习方法(P4R):利用LLM提示策略构建个性化物品描述,并通过预训练BERT模型将其映射至语义表示空间;同时引入图卷积网络(GCN)进行协同过滤表示学习;最终对齐两类嵌入空间以完成通用推荐任务。实验表明,P4R在多个基准数据集上优于现有主流推荐模型,验证了提示词生成画像的有效性。
原文摘要 · Abstract (English)
In recent years, Recommender Systems (RS) have witnessed a transformative shift with the advent of Large Language Models (LLMs) in the field of Natural Language Processing (NLP). Models such as GPT-3.5/4, Llama, have demonstrated unprecedented capabilities in understanding and generating human-like text. The extensive information pre-trained by these LLMs allows for the potential to capture a more profound semantic representation from different contextual information of users and items. While the great potential lies behind the thriving of LLMs, the challenge of leveraging user-item preferences from contextual information and its alignment with the improvement of Recommender Systems needs to be addressed. Believing that a better understanding of the user or item itself can be the key factor in improving recommendation performance, we conduct research on generating informative profiles using state-of-the-art LLMs. To boost the linguistic abilities of LLMs in Recommender Systems, we introduce the Prompting-Based Representation Learning Method for Recommendation (P4R). In our P4R framework, we utilize the LLM prompting strategy to create personalized item profiles. These profiles are then transformed into semantic representation spaces using a pre-trained BERT model for text embedding. Furthermore, we incorporate a Graph Convolution Network (GCN) for collaborative filtering representation. The P4R framework aligns these two embedding spaces in order to address the general recommendation tasks. In our evaluation, we compare P4R with state-of-the-art Recommender models and assess the quality of prompt-based profile generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。