arXiv:2607.17017cs.IRcs.AI2026-07

将两种推荐信号融合,实现高效工业级推荐模型。

WHALE: A Scalable Unified Model for Recommendation with Wukong-HSTU Architecture

论文配图:WHALE: A Scalable Unified Model for Recommendation with Wukong-HSTU Architecture
图 1 · 摘自论文原文
  • 用Wukong和HSTU分别处理非序列与序列特征,通过注意力融合协同建模。
  • 在真实工业数据上,离线指标持续提升,线上效果正向且吞吐损失小。
  • 专为部署优化,支持大规模推荐系统落地应用。

随着推荐模型可扩展性日益重要,现有架构通常分别建模两类排名信号:非序列特征(用户、物品、上下文及交叉特征)与用户行为历史的序列特征。Wukong和HSTU作为代表性可扩展骨干网络,分别擅长高阶非序列特征交互与长序列行为建模。尽管二者优势互补,但联合建模方案仍不充分。本文提出WHALE,一种基于Wukong与HSTU的统一可扩展推荐架构。每一层包含一个Wukong模块、一个HSTU模块及基于注意力的融合模块,其中Wukong生成的交互表示查询HSTU生成的行为表示。该设计保持双骨干全程活跃,实现渐进式信息交换,使高阶特征交叉可反复从长用户历史中获取细粒度证据。为提升工业部署可行性,引入定制Triton内核等模型-系统协同优化技术,显著提升训练与推理效率。在大规模工业数据上,WHALE在离线实验中表现持续领先,并带来正向线上收益,仅伴随轻微服务吞吐下降。该方法已成功部署于生产系统,为两类信息的可扩展统一提供了实用范例。

原文摘要 · Abstract (English)

As scalability becomes increasingly important in recommendation modeling, recent architectures have advanced the modeling of two broad sources of ranking signals along separate paths: non-sequence features, including user, item, context, and cross features; and sequence features from user behavior histories. Wukong and HSTU have emerged as representative scalable backbones for these paths: Wukong scales high-order non-sequence feature-interaction modeling, while HSTU scales long user-behavior sequence modeling. Despite their complementary strengths, practical architectures that combine these two types of feature modeling remain underexplored. We present WHALE, a scalable unified recommendation architecture that jointly models non-sequence and sequence features on top of Wukong and HSTU. Each WHALE layer contains a Wukong module, an HSTU module, and an attention-based fusion module in which Wukong-derived interaction representations query HSTU-derived behavior representations. This design keeps both backbones active throughout the network and enables progressive Wukong-HSTU exchange, allowing high-order feature crosses to repeatedly retrieve fine-grained evidence from long user histories. To make WHALE practical for industrial deployment, we introduce customized Triton kernels and other model-systems co-design techniques to improve training and inference efficiency. On large-scale industrial recommendation data, WHALE achieves consistent gains in offline experiments. Additionally, it delivers positive online gains with a modest serving-throughput trade-off. The method has been deployed in production systems. Overall, WHALE provides a practical example of how these two sources of information can be scalably unified in an industrial recommendation model.

推荐系统可扩展建模双路径融合工业部署

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。