arXiv:2503.02453cs.IRcs.AI2025-03NeurIPS被引 85

将稀疏与稠密表示融合,实现更精准的生成式推荐。

Sparse Meets Dense: Unified Generative Recommendations with Cascaded Sparse-Dense Representations

  • 通过级联方式交替生成稀疏标识符和稠密向量,提升表征质量。
  • 在真实广告平台测试中,关键指标显著提升,日活超2亿用户。
  • 适合追求高精度推荐与多样化结果的工业级系统应用。

生成式模型近年来在推荐系统中受到关注,可直接从用户行为序列中预测物品标识符。然而,现有方法因量化与序列建模阶段分离导致信息丢失,难以达到稠密检索技术的建模精度。为解决此问题,本文提出级联组织双表示生成检索框架COBRA,创新性地通过级联过程融合稀疏语义标识符与稠密向量。该方法先生成稀疏标识符,作为条件辅助生成稠密向量,实现端到端训练下的动态优化,同时捕捉语义信息与用户-物品交互的协同信号。推理时采用粗到精策略:先生成稀疏标识符,再通过生成模型细化为稠密向量。我们进一步提出BeamFusion方法,结合束搜索与最近邻得分,增强推理灵活性与推荐多样性。在多个公开数据集及离线测试中验证了方法的鲁棒性;在线A/B测试于一个日均活跃用户超2亿的真实广告平台,关键指标显著提升,凸显COBRA的实际优势。

原文摘要 · Abstract (English)

Generative models have recently gained attention in recommendation systems by directly predicting item identifiers from user interaction sequences. However, existing methods suffer from significant information loss due to the separation of stages such as quantization and sequence modeling, hindering their ability to achieve the modeling precision and accuracy of sequential dense retrieval techniques. Integrating generative and dense retrieval methods remains a critical challenge. To address this, we introduce the Cascaded Organized Bi-Represented generAtive retrieval (COBRA) framework, which innovatively integrates sparse semantic IDs and dense vectors through a cascading process. Our method alternates between generating these representations by first generating sparse IDs, which serve as conditions to aid in the generation of dense vectors. End-to-end training enables dynamic refinement of dense representations, capturing both semantic insights and collaborative signals from user-item interactions. During inference, COBRA employs a coarse-to-fine strategy, starting with sparse ID generation and refining them into dense vectors via the generative model. We further propose BeamFusion, an innovative approach combining beam search with nearest neighbor scores to enhance inference flexibility and recommendation diversity. Extensive experiments on public datasets and offline tests validate our method's robustness. Online A/B tests on a real-world advertising platform with over 200 million daily users demonstrate substantial improvements in key metrics, highlighting COBRA's practical advantages.

生成推荐稠密表示稀疏表示推荐系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。