arXiv:2502.05822cs.IR2025-02中稿 · WWW 2025被引 3

提升搜索广告图文相关性,让推荐更精准

HCMRM: A High-Consistency Multimodal Relevance Model for Search Ads

  • 用伪查询增强图文对齐,统一预训练与任务一致性
  • 引入分层Softmax损失,提升正负样本区分度
  • 已在快手系统落地,无效广告降6.1%,收入增1.4%

搜索广告在短视频平台中对商家触达目标用户至关重要。通过相关性匹配与竞价排序机制,将与用户搜索意图一致的短视频广告展示给用户。本文聚焦于改进查询-视频相关性匹配,以提升广告系统的排序效果。尽管近期视觉-语言预训练模型在多种多模态任务中表现优异,但其在下游查询-视频相关性任务中的贡献有限,原因在于图像信号与文本之间的对齐方式,不同于查询、视觉信号与视频文本三元组的建模差异。此外,先前的相关性模型排名能力较弱,主要源于二分类交叉熵微调目标与排序目标之间的不一致。为此,我们设计了高一致性多模态相关性模型(HCMRM)。该模型在预训练阶段,除对齐视觉信号与视频文本外,还从视频文本中提取关键词作为伪查询,进行三元组相关性建模;在微调阶段,引入分层Softmax损失,使模型能学习标签间的顺序关系,同时最大化正负样本间的差异,促进后续排序阶段相关性与竞价的融合。该方法已在快手搜索广告系统中部署超过一年,使无关广告占比降低6.1%,广告收入提升1.4%。

原文摘要 · Abstract (English)

Search advertising is essential for merchants to reach the target users on short video platforms. Short video ads aligned with user search intents are displayed through relevance matching and bid ranking mechanisms. This paper focuses on improving query-to-video relevance matching to enhance the effectiveness of ranking in ad systems. Recent vision-language pre-training models have demonstrated promise in various multimodal tasks. However, their contribution to downstream query-video relevance tasks is limited, as the alignment between the pair of visual signals and text differs from the modeling of the triplet of the query, visual signals, and video text. In addition, our previous relevance model provides limited ranking capabilities, largely due to the discrepancy between the binary cross-entropy fine-tuning objective and the ranking objective. To address these limitations, we design a high-consistency multimodal relevance model (HCMRM). It utilizes a simple yet effective method to enhance the consistency between pre-training and relevance tasks. Specifically, during the pre-training phase, along with aligning visual signals and video text, several keywords are extracted from the video text as pseudo-queries to perform the triplet relevance modeling. For the fine-tuning phase, we introduce a hierarchical softmax loss, which enables the model to learn the order within labels while maximizing the distinction between positive and negative samples. This promotes the fusion ranking of relevance and bidding in the subsequent ranking stage. The proposed method has been deployed in the Kuaishou search advertising system for over a year, contributing to a 6.1% reduction in the proportion of irrelevant ads and a 1.4% increase in ad revenue.

搜索广告多模态相关性建模排序优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。