提升双塔推荐模型性能,实现高效在线协同。
CS3: Efficient Online Capability Synergy for Two-Tower Recommendation
- 通过自适应去噪、塔间同步与级联共享三机制增强双塔模型能力。
- 在三个场景中提升广告收入最高达8.36%,延迟保持毫秒级。
- 适合大规模在线推荐系统,兼容多种双塔架构。
为平衡推荐系统的效果与效率,多阶段流水线采用轻量级双塔模型进行大规模候选召回。然而其孤立结构天然限制了表示能力、嵌入空间对齐和跨特征建模。已有研究尝试引入后期交互或知识蒸馏以缓解问题,但常显著增加模型延迟,或难以应用于在线学习场景。为此,我们提出一种高效在线框架——能力协同(CS3),通过三项创新提升双塔模型:(1) 循环自适应结构,通过塔内自适应特征去噪实现自我修正;(2) 双塔同步机制,通过塔间互知改善表示对齐;(3) 级联模型共享,通过复用下游模型知识保证跨阶段一致性。该框架兼容多种双塔架构,满足在线学习实时性要求。我们在三个公开离线数据集上评估,并在大规模广告系统中部署。实验表明,CS3在三个场景中使在线广告收入最高提升8.36%,同时保持毫秒级延迟,并在不同双塔架构下表现稳定。
原文摘要 · Abstract (English)
To balance effectiveness and efficiency in recommender systems, multi-stage pipelines employ lightweight two-tower models for large-scale candidate retrieval. However, their isolated architecture inherently hampers representation capacity, embedding-space alignment, and cross-feature modeling. Prior studies have explored incorporating late interaction or knowledge distillation to mitigate these issues, but such approaches often significantly increase model latency or pose challenges for implementation in online learning scenarios. To address these limitations, we propose an efficient online framework called Capability Synergy (CS3), which enhances two-tower models through three key innovations: (1) Cycle-Adaptive Structure, enabling self-revision via adaptive feature denoising within individual towers; (2) Cross-Tower Synchronization, improving representation alignment through mutual awareness between the towers; and (3) CascadeModel Sharing, bridging cross-stage consistency by reusing knowledge from downstream models. The CS3 framework is compatible with various two-tower architectures and meets real-time requirements in online learning scenarios. We evaluated CS3 on three public offline datasets and subsequently deployed it in a large-scale advertising system. Experimental results demonstrate that CS3 increases online ad revenue by up to 8.36% across three scenarios while maintaining millisecond-level latency and consistently performing well across diverse two-tower architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。