解决推荐系统长序列建模的延迟瓶颈,实现高效实时推荐。
LASER: An Efficient Target-Aware Segmented Attention Framework for End-to-End Long Sequence Modeling
- 用分段目标注意力机制压缩长序列,降低计算开销。
- 通过混合存储索引,检索延迟降低50%,CPU使用减少75%。
- 在超大规模用户场景下提升2.36%点击率,适合工业级部署。
在现代推荐系统中,建模超长用户行为序列对于捕捉动态和终身兴趣至关重要。然而,在真实工业环境中部署此类模型面临严格的“延迟墙”,主要受两大瓶颈制约:海量用户历史数据的高I/O延迟,以及标准注意力机制的二次计算复杂度。为此,我们提出LASER,一个在小红书(RedNote)实际部署的全栈优化框架。通过两项互补创新:(1) 系统效率:引入SeqVault,一种面向长用户历史的统一模式感知服务架构,采用混合DRAM-SSD索引策略,将检索延迟降低50%,CPU使用率下降75%,实现毫秒级访问完整实时与生命周期用户历史;(2) 算法效率:提出分段目标注意力(STA)机制,基于用户兴趣固有的稀疏性,设计基于Sigmoid的门控策略作为静音机制,过滤噪声项,并通过轻量级全局堆叠目标注意力(GSTA)模块,对压缩后的片段进行跨段依赖建模,避免高昂计算成本。该设计有效压缩序列,保持关键信号的同时显著降低复杂度。大量离线评估显示,LASER持续优于现有先进基线。在服务超1亿日活用户的线上大规模A/B测试中,广告曝光价值(ADVV)提升2.36%,收入增长2.08%,验证了其可扩展性与显著商业价值。
原文摘要 · Abstract (English)
Modeling ultra-long user behavior sequences is pivotal for capturing evolving and lifelong interests in modern recommendation systems. However, deploying such models in real-time industrial environments faces a strict "Latency Wall", constrained by two distinct bottlenecks: the high I/O latency of retrieving massive user histories and the quadratic computational complexity of standard attention mechanisms. To break these bottlenecks, we present LASER, a full-stack optimization framework developed and deployed at Xiaohongshu (RedNote). Our approach tackles the challenges through two complementary innovations: (1) System efficiency: We introduce SeqVault, a unified schema-aware serving infrastructure for long user histories. By implementing a hybrid DRAM-SSD indexing strategy, SeqVault reduces retrieval latency by 50% and CPU usage by 75%, ensuring millisecond-level access to full real-time and life-cycle user histories. (2) Algorithmic efficiency: We propose a Segmented Target Attention (STA) mechanism to address the computational overhead. Motivated by the inherent sparsity of user interests, STA employs a sigmoid-based gating strategy that acts as a silence mechanism to filter out noisy items. Subsequently, a lightweight Global Stacked Target Attention (GSTA) module refines these compressed segments to capture cross-segment dependencies without incurring high computational costs. This design performs effective sequence compression, reducing the complexity of long-sequence modeling while preserving critical signals. Extensive offline evaluations demonstrate that LASER consistently outperforms state-of-the-art baselines. In large-scale online A/B testing serving over 100 million daily active users, LASER achieved a 2.36% lift in ADVV and a 2.08% lift in revenue, demonstrating its scalability and significant commercial impact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。