解决生成式推荐的曝光偏差与长尾物品推荐难题
GENPLUGIN: A Plug-and-Play Framework for Long-Tail Generative Recommendation with Exposure Bias Mitigation
- 双编码器+共享解码器架构,通过对比学习对齐语义与ID表示
- 概率性替换真实物品ID,缓解生成过程中的曝光偏差
- 基于检索的数据增强提升长尾物品推荐效果,适合做生成推荐优化
生成式推荐(GenRec)融合大语言模型,降低嵌入成本并省去逐候选评分,受到广泛关注。然而本研究发现,现有方法存在生成曝光偏差和长尾物品泛化能力差两大缺陷。为此提出GENPLUGIN,一种即插即用框架,采用双编码器、共享解码器结构。预训练阶段通过对比学习对齐语言与ID视图,统一物品表示。同时引入新训练策略:以概率方式将真实物品ID token替换为语言-语义编码器预测结果,缓解曝光偏差。为改善长尾推荐,设计基于检索的数据增强机制,微调解码器,使其在长尾场景下利用上下文或协同信息增强物品ID生成。将GENPLUGIN接入多个代表性GenRec模型,实验表明其显著减轻生成时的曝光偏差,大幅提升长尾物品推荐质量。
原文摘要 · Abstract (English)
Generative recommendation (GenRec) offers LLM integration, reduced embedding costs, and eliminates per-candidate scoring, attracting great attention. Despite its promising performance, this study reveals that it suffers from generation exposure bias and poor long-tail item generalization, two critical limitations overlooked by prior works on GenRec. To address these, we propose GENPLUGIN, a plug-and-play framework featuring a dual-encoder, shared-decoder architecture. During pre-training, it aligns language and ID views via contrastive learning, harmonizing item representations across two complementary views. Besides, GENPLUGIN uses a novel training strategy that probabilistically substitutes ground-truth item ID tokens with predictions from the language-semantics encoder, alleviating exposure bias. To improve long-tail generative recommendation, we propose a retrieval-based data augmentation mechanism. It fine-tunes the decoder of GENPLUGIN to endow GENPLUGIN with the ability to use relevant users w.r.t. contexts or collaborative information to augment the generation of item ID tokens in long-tail recommendation scenarios. We have plugged GENPLUGIN into several representative GenRec models and the extensive experiments demonstrate that GENPLUGIN can notably mitigate generation exposure bias during item ID generation while significantly improving the quality of long-tail item recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。