融合生成与密集检索,提升推荐系统效率与冷启动表现
Unifying Generative and Dense Retrieval for Sequential Recommendation
- 将密集检索的用户/物品表征融入生成式检索框架
- 在小规模数据集上实现更高推荐准确率与更低内存占用
- 适合关注冷启动与内存优化的推荐系统研究者
序列密集检索模型利用先进的序列学习技术计算用户和物品表征,并通过用户与所有物品表征的内积进行排序。但该方法需为每个物品存储唯一表征,随物品数量增加导致显著内存开销。相比之下,生成式检索范式通过训练生成模型直接预测物品索引,使用封装语义信息的语义ID,具备更优的大规模应用潜力。然而,两者在公平条件下的对比仍不充分,性能与计算权衡尚不明确。为此,本文在学术基准上对比了两种方法,并提出LIGER(LeveragIng dense retrieval for GEnerative Retrieval),一种融合密集检索与生成式检索的混合模型。该模型整合序列密集检索优势,缓解性能差距,增强冷启动物品推荐能力。实验表明,该混合方法在小规模基准上提升了效率与有效性。
原文摘要 · Abstract (English)
Sequential dense retrieval models utilize advanced sequence learning techniques to compute item and user representations, which are then used to rank relevant items for a user through inner product computation between the user and all item representations. However, this approach requires storing a unique representation for each item, resulting in significant memory requirements as the number of items grow. In contrast, the recently proposed generative retrieval paradigm offers a promising alternative by directly predicting item indices using a generative model trained on semantic IDs that encapsulate items' semantic information. Despite its potential for large-scale applications, a comprehensive comparison between generative retrieval and sequential dense retrieval under fair conditions is still lacking, leaving open questions regarding performance, and computation trade-offs. To address this, we compare these two approaches under controlled conditions on academic benchmarks and propose LIGER (LeveragIng dense retrieval for GEnerative Retrieval), a hybrid model that combines the strengths of these two widely used methods. LIGER integrates sequential dense retrieval into generative retrieval, mitigating performance differences and enhancing cold-start item recommendation in the datasets evaluated. This hybrid approach provides insights into the trade-offs between these approaches and demonstrates improvements in efficiency and effectiveness for recommendation systems in small-scale benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。