统一生成与判别模型,提升工业检索效果与效率
UniGD: A Unified Generative-Discriminative Framework for Industrial Retrieval

- 单模型联合优化生成与相关性判断,减少冗余计算
- 在线测试广告收入增5.78%,延迟降33%,召回率提升超8%
- 适合高并发工业搜索场景,尤其视频/商品/直播广告
生成式检索(GR)在工业搜索广告中前景广阔,但受相关性与延迟要求制约。现有系统将生成与独立相关性模型串联,使生成似然与相关性判别脱节,影响效果并增加服务成本。我们提出统一生成-判别框架UniGD,将检索与相关性评分融合于单一模型。为缓解联合优化中的梯度冲突,引入冲突感知梯度增强(CAGE)以自适应协调两目标。设计码本锚定表示模块(CAM),将物品表示锚定至从多模态预训练模型中蒸馏的分层码本,赋予丰富通用语义先验。针对异构短视频、商品及直播广告,提出异构广告素材建模(HAM),在共享主干上捕捉跨类型语义共性,同时保留类型特异性建模能力。在快手搜索广告平台的在线AB测试显示,UniGD使广告收入提升5.78%,推理延迟降低33%,判别相关性估计性能提升;在NQ320K和MS300K数据集上,召回率@10分别优于最强复现的GR基线8.44%和3.19%。
原文摘要 · Abstract (English)
Generative retrieval (GR) is a promising paradigm for industrial search advertising, yet its deployment is constrained by strict relevance and latency requirements. Existing systems cascade GR with an independent relevance model, decoupling the generative likelihood objective from query-ad relevance discrimination, which compromises effectiveness and increases serving costs. We propose a Unified Generative-Discriminative framework (UniGD) that integrates retrieval and relevance scoring within a single model. To mitigate gradient interference in joint optimization, UniGD introduces Conflict-Aware Gradient Enhancement (CAGE) to adaptively coordinate the two objectives. UniGD further designs a Codebook-Anchored Representation Module (CAM) that anchors item representations to frozen hierarchical codebooks distilled from a multimodal pretrained model, thereby endowing them with rich and generalizable semantic priors. For heterogeneous short-video, product, and live-stream ads, UniGD proposes Heterogeneous Ad-material Modeling (HAM), which captures cross-type semantic commonality over a shared backbone while preserving type-specific modeling capacity. Online AB tests on Kuaishou search advertising platform show that UniGD raises ad revenue by 5.78%, reduces inference latency by 33%, and improves discriminative relevance estimation. On NQ320K and MS300K, UniGD improves Recall@10 over the strongest reproduced GR baseline by 8.44% and 3.19%, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。