提升广告预排系统精准度,兼顾效率与复杂关系建模。
HIT Model: A Hierarchical Interaction-Enhanced Two-Tower Model for Pre-Ranking Systems
- 用双生成器预生成综合向量,增强用户与广告粗粒度交互建模。
- 引入多头表示器捕捉用户多维兴趣和广告多属性特征。
- 在腾讯广告平台实测,点击率提升1.66%,投入产出比提高1.55%。
在线展示广告平台依赖预排系统从海量候选广告中高效筛选并排序,需在用户相关性与严格计算约束间取得平衡。当前主流的双塔架构虽因解耦设计和预缓存具备高效率,但存在跨域交互不足和相似度度量粗糙的问题,限制了对复杂用户-广告关系的建模能力。本文提出层级交互增强双塔(HIT)模型,在双塔范式基础上引入两个核心组件:生成器通过双生成器框架预生成融合粗粒度用户-广告交互的全局向量,并以余弦相似度为依据构建生成损失作为训练目标;多头表示器将嵌入投影至多个潜在子空间,以捕捉用户多维度兴趣与广告多属性特征。该设计在不牺牲推理效率的前提下显著提升建模效果。在公开数据集上的大量实验及腾讯广告平台的大规模线上A/B测试表明,HIT在相关性指标上显著优于多个基线模型,带来1.66%的成交总额增长和1.55%的投资回报率提升,同时保持与原始双塔模型相当的部署延迟。HIT模型已成功部署于腾讯在线展示广告系统,日均服务数十亿次曝光。代码开源地址:https://github.com/HarveyYang123/HIT_model。
原文摘要 · Abstract (English)
Online display advertising platforms rely on pre-ranking systems to efficiently filter and prioritize candidate ads from large corpora, balancing relevance to users with strict computational constraints. The prevailing two-tower architecture, though highly efficient due to its decoupled design and pre-caching, suffers from cross-domain interaction and coarse similarity metrics, undermining its capacity to model complex user-ad relationships. In this study, we propose the Hierarchical Interaction-Enhanced Two-Tower (HIT) model, a new architecture that augments the two-tower paradigm with two key components: $\textit{generators}$ that pre-generate holistic vectors incorporating coarse-grained user-ad interactions through a dual-generator framework with a cosine-similarity-based generation loss as the training objective, and $\textit{multi-head representers}$ that project embeddings into multiple latent subspaces to capture fine-grained, multi-faceted user interests and multi-dimensional ad attributes. This design enhances modeling effectiveness without compromising inference efficiency. Extensive experiments on public datasets and large-scale online A/B testing on Tencent's advertising platform demonstrate that HIT significantly outperforms several baselines in relevance metrics, yielding a $1.66\%$ increase in Gross Merchandise Volume and a $1.55\%$ improvement in Return on Investment, alongside similar serving latency to the vanilla two-tower models. The HIT model has been successfully deployed in Tencent's online display advertising system, serving billions of impressions daily. The code is available at https://github.com/HarveyYang123/HIT_model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。