arXiv:2504.17811cs.IRcs.LG2025-04KDD被引 8

OmniSage统一学习图文与用户行为,提升Pinterest推荐效果

OmniSage: Large Scale, Multi-Entity Heterogeneous Graph Representation Learning

  • 融合图神经网络、序列模型与内容模型,多任务对比学习
  • 在百亿节点图上训练,使全站收藏率提升约2.5%
  • 适合大规模推荐系统研发者参考

表示学习是提升网页应用中搜索与推荐系统性能的关键任务。现有方法包括基于图的关系建模、基于序列的用户行为时序建模以及基于内容的文本与视觉信息利用。然而,整合这些多样化技术以支持多场景应用的统一框架仍面临挑战。本文提出OmniSage,一个在Pinterest上大规模部署的通用表示学习框架。该框架通过多个对比学习任务,将图神经网络、内容模型与用户序列模型有机结合,有效处理图数据、用户序列和内容信号。为支持OmniSage的训练与推理,我们构建了可支撑百亿节点图的高效基础设施。由OmniSage生成的通用表示显著提升了用户体验,在五个应用中带来约2.5%的全站收藏率(repins)增长。本文强调统一表示学习的价值,并公开发布模型代码。

原文摘要 · Abstract (English)

Representation learning, a task of learning latent vectors to represent entities, is a key task in improving search and recommender systems in web applications. Various representation learning methods have been developed, including graph-based approaches for relationships among entities, sequence-based methods for capturing the temporal evolution of user activities, and content-based models for leveraging text and visual content. However, the development of a unifying framework that integrates these diverse techniques to support multiple applications remains a significant challenge. This paper presents OmniSage, a large-scale representation framework that learns universal representations for a variety of applications at Pinterest. OmniSage integrates graph neural networks with content-based models and user sequence models by employing multiple contrastive learning tasks to effectively process graph data, user sequence data, and content signals. To support the training and inference of OmniSage, we developed an efficient infrastructure capable of supporting Pinterest graphs with billions of nodes. The universal representations generated by OmniSage have significantly enhanced user experiences on Pinterest, leading to an approximate 2.5% increase in sitewide repins (saves) across five applications. This paper highlights the impact of unifying representation learning methods, and we make the model code publicly available at https://github.com/pinterest/atg-research/tree/main/omnisage.

图神经网络推荐系统多模态学习大规模训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。