GEMs通过多流架构突破长序列推荐瓶颈,实现超长用户行为序列的高效建模。
GEMs: Breaking the Long-Sequence Barrier in Generative Recommendation with a Multi-Stream Decoder
- 将用户行为分近期、中期、生命周期三流处理,分别用不同策略建模
- 在超10万条交互序列上保持高精度与低延迟,工业级部署验证有效
- 首次实现高并发场景下终身用户兴趣建模,适合长序列推荐场景
生成式推荐(GR)虽具强大序列推理能力,但处理极长用户行为序列时面临计算成本高、序列长度受限的问题,难以捕捉用户长期兴趣;同时注意力机制固有的“近期偏好”偏差进一步削弱对长期历史的学习。为此,本文提出GEMs(Generative rEcommendation with a Multi-stream decoder),一种新型统一框架,通过多流视角突破长序列瓶颈。GEMs将用户行为划分为近期、中期和生命周期三类时间流,并为每一流设计定制化推理方案:近期使用单阶段实时提取器,中期采用轻量级索引器平衡精度与开销,长期则采用两阶段离线-在线压缩模块。三流通过无参数融合策略整合,实现全局兴趣表征。大规模工业数据集上的实验表明,GEMs显著优于现有最先进方法,在推荐准确率上表现优异。值得注意的是,GEMs是首个成功部署于高并发工业环境的终身生成式推荐框架,可在处理超过10万次交互的用户序列时仍保持卓越推理效率。
原文摘要 · Abstract (English)
While generative recommendations (GR) possess strong sequential reasoning capabilities, they face significant challenges when processing extremely long user behavior sequences: the high computational cost forces practical sequence lengths to be limited, preventing models from capturing users' lifelong interests; meanwhile, the inherent "recency bias" of attention mechanisms further weakens learning from long-term history. To overcome this bottleneck, we propose GEMs (Generative rEcommendation with a Multi-stream decoder), a novel and unified framework designed to break the long-sequence barrier by capturing users' lifelong interaction sequences through a multi-stream perspective. Specifically, GEMs partitions user behaviors into three temporal streams$\unicode{x2014}$Recent, Mid-term, and Lifecycle$\unicode{x2014}$and employs tailored inference schemes for each: a one-stage real-time extractor for immediate dynamics, a lightweight indexer for cross attention to balance accuracy and cost for mid-term sequences, and a two-stage offline-online compression module for lifelong modeling. These streams are integrated via a parameter-free fusion strategy to enable holistic interest representation. Extensive experiments on large-scale industrial datasets demonstrate that GEMs significantly outperforms state-of-the-art methods in recommendation accuracy. Notably, GEMs is the first lifelong GR framework successfully deployed in a high-concurrency industrial environment, achieving superior inference efficiency while processing user sequences of over 100,000 interactions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。