arXiv:2511.20564cs.LG2025-11

端到端联合训练提升推荐系统中的图神经网络效果

E2E-GRec: An End-to-End Joint Training Framework for Graph Neural Networks and Recommender Systems

  • 将图神经网络与推荐系统联合训练,避免分步处理的低效
  • 在线测试中用户停留时长提升0.133%,视频跳过率降低0.3171%
  • 适合大规模工业推荐系统,尤其关注性能与效率的场景

图神经网络(GNN)在建模用户-物品复杂关系方面表现优异,广泛应用于推荐系统。然而,现有工业部署多采用两阶段流程:先离线预训练GNN生成节点嵌入,再作为静态特征输入推荐系统。这种解耦方式带来两大问题:一是大规模GNN推理重复执行,计算开销高;二是推荐系统的梯度无法反向影响GNN学习,导致嵌入对推荐任务不最优。本文提出E2E-GRec,一种端到端联合训练框架,包含三个核心组件:(i) 从大规模跨域异构图中高效采样子图,保障训练可扩展性;(ii) 图特征自编码器(GFAE)作为辅助自监督任务,引导GNN学习结构有意义的嵌入;(iii) 两级特征融合机制结合基于Gradnorm的动态损失平衡,稳定图感知多任务联合训练。大量离线评估、线上A/B测试(如用户停留时长提升0.133%,平均跳过视频数减少0.3171%)及理论分析表明,E2E-GRec显著优于传统方法,在多个推荐指标上持续取得提升。

原文摘要 · Abstract (English)

Graph Neural Networks (GNNs) have emerged as powerful tools for modeling graph-structured data and have been widely used in recommender systems, such as for capturing complex user-item and item-item relations. However, most industrial deployments adopt a two-stage pipeline: GNNs are first pre-trained offline to generate node embeddings, which are then used as static features for downstream recommender systems. This decoupled paradigm leads to two key limitations: (1) high computational overhead, since large-scale GNN inference must be repeatedly executed to refresh embeddings; and (2) lack of joint optimization, as the gradient from the recommender system cannot directly influence the GNN learning process, causing the GNN to be suboptimally informative for the recommendation task. In this paper, we propose E2E-GRec, a novel end-to-end training framework that unifies GNN training with the recommender system. Our framework is characterized by three key components: (i) efficient subgraph sampling from a large-scale cross-domain heterogeneous graph to ensure training scalability and efficiency; (ii) a Graph Feature Auto-Encoder (GFAE) serving as an auxiliary self-supervised task to guide the GNN to learn structurally meaningful embeddings; and (iii) a two-level feature fusion mechanism combined with Gradnorm-based dynamic loss balancing, which stabilizes graph-aware multi-task end-to-end training. Extensive offline evaluations, online A/B tests (e.g., a +0.133% relative improvement in stay duration, a 0.3171% reduction in the average number of videos a user skips) on large-scale production data, together with theoretical analysis, demonstrate that E2E-GRec consistently surpasses traditional approaches, yielding significant gains across multiple recommendation metrics.

图神经网络推荐系统端到端训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。