arXiv:2604.11440cs.IR2026-04被引 4

用参考向量稳定推荐生成中的语义编码,提升冷启动效果。

R3-VAE: Reference Vector-Guided Rating Residual Quantization VAE for Generative Recommendation

论文配图:R3-VAE: Reference Vector-Guided Rating Residual Quantization VAE for Generative Recommendation
图 1 · 摘自论文原文
  • 引入参考向量锚定初始特征,降低对初始化的敏感性。
  • 通过评分点积机制稳定训练,防止码本坍缩,提升编码质量。
  • 提出两项评估指标,支持高效无须训练的语义编码优化。

生成式推荐(GR)因其优异性能和冷启动能力受到关注。其中,语义标识符(SIDs)通过离散令牌表示物品语义,但现有基于向量量化的方法存在两大挑战:(i) 训练不稳定,源于直通估计器梯度传播不足及对初始化敏感;(ii) SID质量评估效率低,工业界仍依赖昂贵的GR训练与A/B测试。为此,我们提出参考向量引导的评分残差量化变分自编码器(R3-VAE)。该框架包含三项创新:(i) 引入参考向量作为初始特征的语义锚点,缓解初始化敏感性;(ii) 设计基于点积的评分机制,稳定训练并防止码本坍缩;(iii) 提出语义一致性与偏好区分两个评估指标,作为训练过程中的正则项。在六个基准数据集上的实验表明,R3-VAE显著优于现有方法,在Beauty、Sports、Toys三个公开数据集上,Recall@10平均提升14.5%,NDCG@10平均提升15.5%。在头条平台的GR训练与在线A/B测试中,该方法使MRR提升1.62%,StayTime/U增长0.83%。此外,将R3-VAE用于替换CTR模型的物品ID,内容冷启动效果提升15.36%,验证了其在工业级推荐场景中的强适用性与商业价值。

原文摘要 · Abstract (English)

Generative Recommendation (GR) has gained traction for its merits of superior performance and cold-start capability. As the vital role in GR, Semantic Identifiers (SIDs) represent item semantics through discrete tokens. However, current techniques for SID generation based on vector quantization face two main challenges: (i) training instability, stemming from insufficient gradient propagation through the straight-through estimator and sensitivity to initialization; and (ii) inefficient SID quality assessment, where industrial practice still depends on costly GR training and A/B testing. To address these challenges, we propose Reference Vector-Guided Rating Residual Quantization VAE (R3-VAE). This framework incorporates three key innovations: (i) a reference vector that functions as a semantic anchor for the initial features, thereby mitigating sensitivity to initialization; (ii) a dot product-based rating mechanism designed to stabilize the training process and prevent codebook collapse; and (iii) two SID evaluation metrics, Semantic Cohesion and Preference Discrimination, serving as regularization terms during training. Empirical results on six benchmarks demonstrate that R3-VAE outperforms state-of-the-art methods, achieving an average improvement of 14.5% in Recall@10 and 15.5% in NDCG@10 across three public datasets (Beauty, Sports, and Toys). Furthermore, we perform GR training and online A/B tests on Toutiao. Our method achieves a 1.62% improvement in MRR and a 0.83% gain in StayTime/U versus baselines. Additionally, we employ R3-VAE to replace the item ID of CTR model, resulting in significant improvements in content cold start by 15.36%, corroborating the strong applicability and business value in industry-scale recommendation scenarios.

生成推荐语义编码冷启动向量量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。