UniFormer统一建模空间,高效提升工业推荐系统性能。
UniFormer: Efficient and Unified Model-Centric Scaling for Industrial Recommendation

- 分特征与任务空间建模,引入语义分词实现请求级加速
- 多序列交叉注意力防偏好坍塌,多视角前馈网络支持灵活扩展
- 线上测试在双场景下显著提升停留与观看时长
近年来,工业推荐系统通过组件中心的模型扩展取得显著进展,如行为建模、特征交互或任务建模等独立扩容。尽管HyFormer和OneTrans等方法探索了跨模块协同扩展,但其设计仍局限于特征空间,缺乏整体建模空间的统一扩展框架。本文提出UniFormer,一种高效且统一的模型中心式扩展框架。为提升效率,UniFormer将整体建模空间分解为特征空间与任务空间,分别由堆叠的特征空间交互模块与任务空间交互模块建模;引入基于语义的分词方案,实现用户-物品解耦,达成请求级推理加速。为防止偏好坍塌,采用多序列交叉注意力分别捕捉异构行为模式,并通过自注意力增强交互建模;同时引入专用多视图前馈网络(FFNs),支持各建模组件的灵活可扩展参数配置。在快手及快手极速版两个生产场景的大量线上A/B测试表明,UniFormer持续提升用户参与度与互动指标,分别带来应用停留时间+0.101%/+0.260%与观看时长+0.729%/+1.113%的提升。
原文摘要 · Abstract (English)
Recently, substantial progress has been made in industrial recommendation through component-centric model scaling, where individual components such as behavior modeling, feature interaction, or task modeling are independently scaled to improve model capacity. Although recent methods such as HyFormer and OneTrans further explore cross-module co-scaling by jointly modeling behavior and interaction, their designs are still confined to the feature space and lack a unified model-centric scaling framework over the overall modeling space. In this paper, we propose UniFormer, an efficient and unified model-centric scaling framework for industrial recommender systems. To improve efficiency, UniFormer decomposes the overall modeling space into feature and task spaces, which are modeled by stacked Feature-space Interaction Modules and Task-space Interaction Modules, respectively. Moreover, UniFormer introduces semantic-based tokenization scheme to enable user-item decoupling, thereby achieving request-level inference acceleration. To prevent preference collapse, UniFormer employs multi-sequence cross-attention to separately capture heterogeneous behavior patterns, followed by the self-attention to enhance interaction modeling. Besides, dedicated multi-view FFNs are introduced to support flexible and scalable parameter scaling across different modeling components. Extensive online A/B testing in two production scenarios, Kuaishou and Kuaishou Lite, shows that UniFormer consistently improves user engagement and interaction metrics, achieving gains of +0.101%/+0.260% in App Stay Time and +0.729%/+1.113% in Watch Time, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。