arXiv:2607.28940cs.IR2026-07KDD

TransX通过分离行为与服务流,实现高效推荐建模与低延迟部署。

TransX: Scaling Transformer-based Recommendation via Behavioral and Serving Stream Crossings

论文配图:TransX: Scaling Transformer-based Recommendation via Behavioral and Serving Stream Crossings
图 1 · 摘自论文原文
  • 将用户行为与实时服务事件分开展示,用跨注意力融合预测下一步动作。
  • 线上测试提升点击率6.0%、转化率4.4%,推理计算量降低约80%。
  • 适合大规模工业推荐系统,兼顾性能与部署效率。

现代工业推荐系统越来越多采用基于Transformer的序列模型,其主流范式将推荐任务建模为统一用户序列上的下一个标记预测。然而,将长期用户行为与实时服务事件等异构数据源压缩进单一连续标记流中,会掩盖其不同因果角色和时间特性,导致建模效率低下及训练与服务成本升高。我们提出TransX,一种面向生产环境的编码器-解码器架构,将推荐重构为序列到序列的动作转换问题。TransX显式分离行为流建模与服务事件建模,并通过近线行为编码与实时服务表示之间的可扩展交叉注意力来条件化下一步动作解码。为支持低延迟、高每秒查询率(QPS)部署,TransX与一种分摊式服务策略协同设计,结合增量行为编码与按请求键值缓存,使服务延迟对行为序列长度不敏感。在LinkedIn推荐系统的离线实验与大规模在线A/B测试表明,TransX持续优于最先进深度学习推荐模型(DLRMs)与序列基线,在保持现有生产模型服务成本水平的同时,带来显著的点击率提升(+6.0%)与转化率增长(+4.4%),且所设计的服务策略将在线计算量减少约80%。

原文摘要 · Abstract (English)

Modern industrial recommender systems (RecSys) increasingly adopt Transformer-based sequence models, with an emerging paradigm that frames recommendation as next-token prediction over a unified monolithic user sequence. However, collapsing heterogeneous data sources -- such as long-term user behaviors and real-time serving events -- into a single monolithic token stream that obscures their distinct causal roles and temporal characteristics, leading to inefficient modeling and elevated training and serving costs. We propose TransX, a production-oriented encoder-decoder architecture that reformulates recommendation as a sequence-to-sequence action transduction problem. TransX explicitly decouples behavior-stream modeling from serving-event modeling and conditions next-action decoding on scalable cross-attention between nearline behavior encodings and real-time serving representations. To enable low-latency, high-QPS deployment, TransX is co-designed with an amortized serving strategy that combines incremental behavior encoding with per-request key-value caching, rendering serving latency insensitive to behavior sequence length. Extensive offline experiments and large-scale online A/B tests on LinkedIn's recommender systems show that TransX consistently outperforms state-of-the-art DLRMs and sequential baselines, and delivers substantial CTR lift (+6.0%) and conversion gain (+4.4%) while maintaining serving costs comparable to existing production models where our co-designed serving strategy reduces online computation by approximately 80%.

推荐系统Transformer低延迟序列建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。