arXiv:2510.21714cs.IR2025-10被引 3

跨域行为序列建模,提升广告推荐效果

Practice on Long Behavior Sequence Modeling in Tencent Advertising

  • 分两阶段构建跨广告与内容域的统一行为序列
  • 在微信渠道实现4.22% GMV提升,朋友圈1.96%增长
  • 适合大规模广告系统中长序列建模的工程实践

长序列建模已成为推荐系统捕捉用户长期偏好的关键。然而,广告领域内的用户行为天然稀疏,仅依赖单一广告域数据难以构建有效长序列。为此,我们采集跨广告场景及内容领域的用户行为,构建统一商业行为轨迹。这一跨域融合带来三大挑战:(1) 不同场景间特征分类体系差异;(2) 无关特征字段间的干扰;(3) 优化不同广告目标时时间与语义模式的靶向干扰。为此,我们在两阶段框架中提出多项实用方法:第一阶段(搜索)采用分层硬搜索处理复杂特征层级,结合解耦嵌入软搜索缓解注意力与表示冲突;第二阶段(序列建模)引入:(a) 解耦侧信息时序兴趣网络(Decoupled Side Information TIN)缓解字段间干扰;(b) 靶向解耦位置编码与靶向解耦SASRec应对靶向干扰;(c) 堆叠TIN建模高阶行为关联。在腾讯大规模广告平台上线后,模型在微信渠道整体提升4.22% GMV,微信朋友圈提升1.96% GMV。

原文摘要 · Abstract (English)

Long-sequence modeling has become an indispensable frontier in recommendation systems for capturing users' long-term preferences. However, user behaviors within advertising domains are inherently sparse, posing a significant barrier to constructing long behavioral sequences using data from a single advertising domain alone. This motivates us to collect users' behaviors not only across diverse advertising scenarios, but also beyond the boundaries of the advertising domain into content domains-thereby constructing unified commercial behavior trajectories. This cross-domain or cross-scenario integration gives rise to the following challenges: (1) feature taxonomy gaps between distinct scenarios and domains, (2) inter-field interference arising from irrelevant feature field pairs, and (3) target-wise interference in temporal and semantic patterns when optimizing for different advertising targets. To address these challenges, we propose several practical approaches within the two-stage framework for long-sequence modeling. In the first (search) stage, we design a hierarchical hard search method for handling complex feature taxonomy hierarchies, alongside a decoupled embedding-based soft search to alleviate conflicts between attention mechanisms and feature representation. In the second (sequence modeling) stage, we introduce: (a) Decoupled Side Information Temporal Interest Networks (TIN) to mitigate inter-field conflicts; (b) Target-Decoupled Positional Encoding and Target-Decoupled SASRec to address target-wise interference; and (c) Stacked TIN to model high-order behavioral correlations. Deployed in production on Tencent's large-scale advertising platforms, our innovations delivered significant performance gains: an overall 4.22% GMV lift in WeChat Channels and an overall 1.96% GMV increase in WeChat Moments.

推荐系统长序列建模跨域推荐广告算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。