arXiv:2504.10507cs.IRcs.LG2025-04KDD被引 19

统一生成式推荐模型,跨多场景提升推荐效果。

PinRec: Unified Generative Retrieval for Pinterest Recommender Systems

  • 用统一模型预训练+各场景微调,适配不同业务需求。
  • 在搜索场景实现保存率提升4%,兼顾性能与多样性。
  • 支持主页、搜索、相关图片等多场景部署,适合大规模平台。

生成式检索方法利用序列建模技术(如Transformer)为推荐系统生成候选项目,已在学术基准上超越传统双塔模型。然而,现有方法通常需为每个产品场景单独建模,难以构建统一模型以满足不同业务需求。此外,多数方法仅关注预测下一个物品,未能捕捉用户兴趣随时间演变的过程。本文提出PinRec,一种适用于Pinterest所有推荐场景(包括主页推荐、搜索、相关图片)的统一生成式检索模型。该模型在跨场景的用户行为序列上进行预训练,再针对各场景的曝光数据进行微调,实现单一模型支撑多场景。为更好对齐各场景的业务目标,PinRec引入新型结果条件生成机制,使微调更具针对性。实验表明,PinRec在性能、多样性与效率间取得良好平衡,在搜索场景中实现保存率提升4%。据我们所知,这是首个在Pinterest规模上构建并上线的统一生成式检索模型,具有里程碑意义。

原文摘要 · Abstract (English)

Generative retrieval methods employ sequential modeling techniques, like transformers, to generate candidate items for recommender systems. These methods have demonstrated promising results in academic benchmarks, surpassing traditional retrieval models such as two-tower architectures. However, a key limitation is that current approaches require a separate model for each product surface, as building a unified model that accommodates the different business needs of various surfaces has proven challenging. Furthermore, existing methods often fail to capture the evolution of user interests over a sequence, focusing instead on only predicting the next item. This paper introduces Pinrec, a novel unified generative retrieval model for all of Pinterest's recommendation surfaces, including home feed, search, and related pins. Pinrec is pretrained on user activity sequences aggregated across surfaces, then fine-tuned for each surface using that surface's impression data. This pretraining-fine-tuning approach enables a single unified model while still adapting to the needs of individual surfaces. To better align recommendations with surface-specific business goals, Pinrec incorporates a novel outcome-conditioned generation mechanism that targets different outcomes for each surface, which further enhances the impact of fine-tuning. Our experiments show that Pinrec balances performance, diversity, and efficiency, delivering significant gains such as +4% increase in search saves. To our knowledge, this paper presents the first rigorous study of a unified generative retrieval model built and deployed at Pinterest scale, marking a significant milestone in the field.

推荐系统生成式检索统一模型大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。