解决语言模型与推荐系统间的分布不匹配问题,提升生成式推荐效果
Towards Distribution Matching between Collaborative and Language Spaces for Generative Recommendation
- 引入概率元网络桥接语言模型输出与用户行为
- 设计三种跨空间分布对齐机制,提升信息共享与语义保留
- 适用于各类生成式推荐模型,显著优于主流语言模型增强方法
生成式推荐旨在学习整个物品集上的潜在生成过程,为用户提供推荐。尽管其利用非线性概率模型超越了线性因子模型的建模能力限制,但仍面临表示能力与可计算性之间的权衡。随着基于预训练语言模型(LMs)的新一代生成方法兴起,将语言模型融入隐式反馈场景下的通用推荐受到广泛关注。然而,将其适配到生成式推荐仍具挑战性,核心原因在于生成模型与语言模型在输入输出格式和语义上存在不匹配,难以实现特征空间中的最优对齐。本文提出一种模型无关的生成式推荐框架DMRec,引入概率元网络将语言模型输出与用户交互进行桥接,从而实现等价的概率建模过程。进一步设计三种跨空间分布匹配机制,旨在最大化共享信息的同时保留各空间独特语义并过滤无关信息。我们将DMRec应用于三种不同类型的生成式推荐方法,并在三个公开数据集上进行大量实验。结果表明,DMRec能有效提升这些生成模型的推荐性能,在多个指标上显著优于主流的语言模型增强推荐方法。
原文摘要 · Abstract (English)
Generative recommendation aims to learn the underlying generative process over the entire item set to produce recommendations for users. Although it leverages non-linear probabilistic models to surpass the limited modeling capacity of linear factor models, it is often constrained by a trade-off between representation ability and tractability. With the rise of a new generation of generative methods based on pre-trained language models (LMs), incorporating LMs into general recommendation with implicit feedback has gained considerable attention. However, adapting them to generative recommendation remains challenging. The core reason lies in the mismatch between the input-output formats and semantics of generative models and LMs, making it challenging to achieve optimal alignment in the feature space. This work addresses this issue by proposing a model-agnostic generative recommendation framework called DMRec, which introduces a probabilistic meta-network to bridge the outputs of LMs with user interactions, thereby enabling an equivalent probabilistic modeling process. Subsequently, we design three cross-space distribution matching processes aimed at maximizing shared information while preserving the unique semantics of each space and filtering out irrelevant information. We apply DMRec to three different types of generative recommendation methods and conduct extensive experiments on three public datasets. The experimental results demonstrate that DMRec can effectively enhance the recommendation performance of these generative models, and it shows significant advantages over mainstream LM-enhanced recommendation methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。