arXiv:2502.09888cs.IR2025-02被引 17

解决推荐模型扩展性难题,实现高效低延迟大规模推荐。

Climber: Toward Efficient Scaling Laws for Large Recommendation Models

  • 采用多尺度序列提取与动态温度调制,优化长序列处理效率。
  • 在线推理延迟控制在毫秒级,吞吐量提升5.15倍,性能不降。
  • 适合高并发、长行为序列的实时推荐系统,如音乐流媒体平台。

基于Transformer的生成模型在多个领域取得显著成功,但将其应用于推荐系统时仍面临持续挑战:(1) 变换器的扩展性不佳,因结构与推荐特有的多源数据异构性不兼容;(2) 在线推理延迟要求严苛(数十毫秒),随用户行为序列变长和计算需求增长而加剧。我们提出Climber,一个由高效扩展模型架构与协同加速技术组成的推荐框架。核心创新包括:(1) 多尺度序列提取,实现时间复杂度常数级降低,提升序列长度扩展效率;(2) 动态温度调制,适配多场景与多行为模式的注意力分布。结合批处理与内存高效的键值缓存,Climber在不损失性能的前提下实现5.15倍吞吐量提升。多数据集离线实验验证其具备更理想的扩展曲线。据我们所知,这是首个公开文档记录中通过可控模型扩展实现持续线上指标增长(整体提升12.19%)且无高昂资源成本的框架。Climber已成功部署于网易云音乐,服务每日超千万用户。

原文摘要 · Abstract (English)

Transformer-based generative models have achieved remarkable success across domains with various scaling law manifestations. However, our extensive experiments reveal persistent challenges when applying Transformer to recommendation systems: (1) Transformer scaling is not ideal with increased computational resources, due to structural incompatibilities with recommendation-specific features such as multi-source data heterogeneity; (2) critical online inference latency constraints (tens of milliseconds) that intensify with longer user behavior sequences and growing computational demands. We propose Climber, an efficient recommendation framework comprising two synergistic components: the model architecture for efficient scaling and the co-designed acceleration techniques. Our proposed model adopts two core innovations: (1) multi-scale sequence extraction that achieves a time complexity reduction by a constant factor, enabling more efficient scaling with sequence length; (2) dynamic temperature modulation adapting attention distributions to the multi-scenario and multi-behavior patterns. Complemented by acceleration techniques, Climber achieves a 5.15$\times$ throughput gain without performance degradation by adopting a "single user, multiple item" batched processing and memory-efficient Key-Value caching. Comprehensive offline experiments on multiple datasets validate that Climber exhibits a more ideal scaling curve. To our knowledge, this is the first publicly documented framework where controlled model scaling drives continuous online metric growth (12.19\% overall lift) without prohibitive resource costs. Climber has been successfully deployed on Netease Cloud Music, one of China's largest music streaming platforms, serving tens of millions of users daily.

推荐系统模型扩展低延迟Transformer

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。