腾讯提出分层生成推荐框架HiGR,显著提升大规模推荐的效率与效果。
HiGR: Industrial-Scale Hierarchical Generative Slate Recommendation Framework in Tencent
- 分层设计:先生成结构化语义编码,再基于编码生成推荐列表。
- 离线效果超顶尖模型10%以上,推理速度提升5倍。
- 适合大规模推荐系统部署,已在腾讯多平台落地应用。
榜单推荐在主流在线平台中普遍存在,即以单屏展示排序后的项目列表。尽管近期生成式推荐方法在建模带语义标识的项目序列方面展现出强大潜力,但直接应用于工业级榜单推荐仍面临根本性断层:语义标识空间纠缠导致高层规划困难,长序列细粒度自回归解码降低语义规划效率,且词元级目标与整体榜单质量不一致。本文提出HiGR——一个面向工业级榜单推荐的分层生成框架,通过协同设计的流水线解决该断层。首先,HiGR利用前缀对比残差量化变分自编码器(PCRQ-VAE)学习结构化语义标识,强制高层前缀捕捉共享语义,构建可控离散空间,为高效规划奠定基础。基于此结构化空间,层级榜单解码器(HSD)将自回归建模从纠缠的词元级解码转为粗粒度偏好嵌入,显著降低推理延迟,并支持显式全局榜单结构规划。最终,这一稳定规划空间使基于ORPO的列表级对齐机制能够优化三重目标:隐式反馈排序保真度、真实用户兴趣和多样性。大量离线实验表明,HiGR在离线推荐质量上优于最先进基线超过10%,同时实现5倍推理加速。在腾讯平台的线上A/B测试进一步提升了1.22%观看时长和1.73%视频播放量。HiGR已部署于多个腾讯平台界面,服务数亿用户,验证了其工业级可扩展性。
原文摘要 · Abstract (English)
Slate recommendation, which presents users with a ranked item list in a single display, is ubiquitous across mainstream online platforms. While recent generative recommendation methods have shown strong potential in modeling item sequences with semantic IDs, directly applying them to industrial-scale slate recommendation faces a fundamental disconnect: entangled SID spaces confound high-level list planning, fine-grained autoregressive decoding over long sequences limits semantic planning efficiency, and token-level objectives misalign with holistic slate quality. In this paper, we propose HiGR, an industrial-scale hierarchical generative framework for slate recommendation that bridges this disconnect through a co-designed pipeline. First, HiGR learns structured SIDs via a Prefix-Contrastive Residual Quantized VAE (PCRQ-VAE). By enforcing high-level prefixes to capture shared semantics, PCRQ-VAE creates a controllable discrete space that acts as a prerequisite for efficient planning. Leveraging this structured space, our Hierarchical Slate Decoder (HSD) shifts autoregressive modeling from entangled token-level decoding to coarse-grained preference embeddings. This design significantly reduces inference latency while allowing explicit global slate structure planning. Finally, this stable planning space enables an ORPO-based listwise alignment mechanism to optimize triple-objective implicit feedback-ranking fidelity, genuine user interest, and diversity. Extensive offline experiments show that HiGR outperforms state-of-the-art baselines by over 10% in offline recommendation quality while achieving a $5\times$ inference speedup. Online A/B tests on Tencent platforms further improve watch time by 1.22% and video plays by 1.73%. HiGR has been deployed on multiple Tencent platform surfaces, serving hundreds of millions of users and proving its industrial-scale applicability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。