让生成式推荐能猜出训练没见过的商品,提升推荐新颖性。
Inductive Generative Recommendation via Retrieval-based Speculation
- 用一个可独立推理的草稿模型提出候选商品,包括新商品。
- 生成模型作为验证者,保持排名能力同时提高对新商品的推荐率。
- 支持外置草稿或自生成草稿,兼顾效果与参数效率。
生成式推荐(GR)将物品离散化为令牌并自回归生成下一个令牌以进行预测。尽管该范式有望超越传统归纳方法,能够基于语义直接生成新物品,但我们实证发现GR模型主要生成训练中见过的物品,难以推荐未见物品。本文提出SpecGR,一种即插即用的框架,使GR模型能在归纳设置下推荐新物品。SpecGR使用具备归纳能力的草稿模型提出候选物品(可能包含新物品),而GR模型则充当验证者,接受或拒绝候选,同时保留其强排序能力。我们进一步引入引导重草稿技术,使候选更贴近生成式推荐输出,提升验证效率。草稿方式分为两种:(1) 使用辅助草稿模型以增强灵活性;(2) 利用GR模型自身编码器实现参数高效的自草稿。在三个真实数据集上的大量实验表明,SpecGR在归纳推荐能力上表现强劲,且整体性能优于对比方法。代码已公开于:https://github.com/Jamesding000/SpecGR。
原文摘要 · Abstract (English)
Generative recommendation (GR) is an emerging paradigm that tokenizes items into discrete tokens and learns to autoregressively generate the next tokens as predictions. While this token-generation paradigm is expected to surpass traditional transductive methods, potentially generating new items directly based on semantics, we empirically show that GR models predominantly generate items seen during training and struggle to recommend unseen items. In this paper, we propose SpecGR, a plug-and-play framework that enables GR models to recommend new items in an inductive setting. SpecGR uses a drafter model with inductive capability to propose candidate items, which may include both existing items and new items. The GR model then acts as a verifier, accepting or rejecting candidates while retaining its strong ranking capabilities. We further introduce the guided re-drafting technique to make the proposed candidates more aligned with the outputs of generative recommendation models, improving the verification efficiency. We consider two variants for drafting: (1) using an auxiliary drafter model for better flexibility, or (2) leveraging the GR model's own encoder for parameter-efficient self-drafting. Extensive experiments on three real-world datasets demonstrate that SpecGR exhibits both strong inductive recommendation ability and the best overall performance among the compared methods. Our code is available at: https://github.com/Jamesding000/SpecGR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。