用语义相关性为主监督,提升电商广告搜索召回效果
Unified Supervision for Walmart's Sponsored Search Retrieval via Joint Semantic Relevance and Behavioral Engagement Modeling

- 以多阶段交叉编码器生成的分级相关标签为主监督信号
- 结合检索系统排名与用户行为,在相关项中优化偏好排序
- 适合电商广告搜索、需平衡相关性与真实点击的场景
现代搜索系统依赖快速的第一阶段检索器从海量商品中筛选相关项。现有系统常利用用户行为信号监督双编码器检索器训练,因其来自真实流量且无需额外标注。然而,行为信号是语义相关性的不完美代理:商品可能因热度、促销、视觉或价格等因素获得互动,即使与查询无关。这一问题在沃尔玛电商广告搜索中尤为突出——广告曝光受限于竞价、预算等非相关因素,导致高相关性查询-广告对也可能缺乏行为信号。为此,我们提出一种双编码器训练框架,以语义相关性为主要监督信号,仅将行为信号作为相关项间的偏好参考。具体通过三部分构建上下文丰富的训练目标:1. 多阶段交叉编码器教师模型提供的分级相关标签;2. 基于生产环境中多个检索系统的排名位置与跨通道一致性计算的多通道先验得分;3. 仅作用于语义相关项的行为信号,用于细化排序偏好。该方法在离线评估与在线AB测试中均优于当前生产系统,显著提升平均相关性与NDCG指标。
原文摘要 · Abstract (English)
Modern search systems rely on a fast first stage retriever to fetch relevant items from a massive catalog of items. Deployed search systems often use user engagement signals to supervise bi-encoder retriever training at scale, because these signals are continuously logged from real traffic and require no additional annotation effort. However, engagement is an imperfect proxy for semantic relevance. Items may receive interactions due to popularity, promotion, attractive visuals, titles, or price, despite weak query-item relevance. These limitations are further accentuated in Walmart's e-commerce sponsored search. User engagement on ad items is often structurally sparse because the frequency with which an ad is shown depends on factors beyond relevance such as whether the advertiser is currently running that ad, the outcome of the auction for available ad slots, bid competitiveness, and advertiser budget. Thus, even highly relevant query ad pairs can have limited engagement signals simply due to limited impressions. We propose a bi-encoder training framework for Walmart's sponsored search retrieval in e-commerce that uses semantic relevance as the primary supervision signal, with engagement used only as a preference signal among relevant items. Concretely, we construct a context-rich training target by combining 1. graded relevance labels from a cascade of cross-encoder teacher models, 2. a multichannel retrieval prior score derived from the rank positions and cross-channel agreement of retrieval systems running in production, and 3. user engagement applied only to semantically relevant items to refine preferences. Our approach outperforms the current production system in both offline evaluation and online AB tests, yielding consistent gains in average relevance and NDCG.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。