arXiv:2602.13631cs.IR2026-02被引 3

GEMs通过多流架构突破长序列推荐瓶颈,实现超长用户行为序列的高效建模。

GEMs: Breaking the Long-Sequence Barrier in Generative Recommendation with a Multi-Stream Decoder

  • 将用户行为分近期、中期、生命周期三流处理,分别用不同策略建模
  • 在超10万条交互序列上保持高精度与低延迟,工业级部署验证有效
  • 首次实现高并发场景下终身用户兴趣建模,适合长序列推荐场景

生成式推荐(GR)虽具强大序列推理能力,但处理极长用户行为序列时面临计算成本高、序列长度受限的问题,难以捕捉用户长期兴趣;同时注意力机制固有的“近期偏好”偏差进一步削弱对长期历史的学习。为此,本文提出GEMs(Generative rEcommendation with a Multi-stream decoder),一种新型统一框架,通过多流视角突破长序列瓶颈。GEMs将用户行为划分为近期、中期和生命周期三类时间流,并为每一流设计定制化推理方案:近期使用单阶段实时提取器,中期采用轻量级索引器平衡精度与开销,长期则采用两阶段离线-在线压缩模块。三流通过无参数融合策略整合,实现全局兴趣表征。大规模工业数据集上的实验表明,GEMs显著优于现有最先进方法,在推荐准确率上表现优异。值得注意的是,GEMs是首个成功部署于高并发工业环境的终身生成式推荐框架,可在处理超过10万次交互的用户序列时仍保持卓越推理效率。

原文摘要 · Abstract (English)

While generative recommendations (GR) possess strong sequential reasoning capabilities, they face significant challenges when processing extremely long user behavior sequences: the high computational cost forces practical sequence lengths to be limited, preventing models from capturing users' lifelong interests; meanwhile, the inherent "recency bias" of attention mechanisms further weakens learning from long-term history. To overcome this bottleneck, we propose GEMs (Generative rEcommendation with a Multi-stream decoder), a novel and unified framework designed to break the long-sequence barrier by capturing users' lifelong interaction sequences through a multi-stream perspective. Specifically, GEMs partitions user behaviors into three temporal streams$\unicode{x2014}$Recent, Mid-term, and Lifecycle$\unicode{x2014}$and employs tailored inference schemes for each: a one-stage real-time extractor for immediate dynamics, a lightweight indexer for cross attention to balance accuracy and cost for mid-term sequences, and a two-stage offline-online compression module for lifelong modeling. These streams are integrated via a parameter-free fusion strategy to enable holistic interest representation. Extensive experiments on large-scale industrial datasets demonstrate that GEMs significantly outperforms state-of-the-art methods in recommendation accuracy. Notably, GEMs is the first lifelong GR framework successfully deployed in a high-concurrency industrial environment, achieving superior inference efficiency while processing user sequences of over 100,000 interactions.

生成式推荐长序列建模多流架构工业部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。