用查询桥接的离散语义标识,提升电商搜索相关性排序效果。
DSIRM: Learning Query-Bridged Discrete Semantic Identifiers for E-commerce Relevance Modeling

- 通过查询-物品交互监督改进量化,生成与查询相关的离散语义标识。
- 在天猫真实数据上,离线AUC提升1.54%,在线点击率和转化率显著增长。
- 适合需要精准匹配用户意图的电商搜索系统,尤其擅长处理长尾查询。
尽管连续嵌入在电商搜索相关性建模中取得进展,但细粒度属性区分仍存在难题。离散语义标识(SIDs)虽具潜力,但现有方法依赖无监督量化,缺乏显式监督导致难以确定哪些商品应共享同一标识,限制了查询相关的排序能力。为此,我们提出离散语义标识相关性模型(DSIRM),在物品端引入查询桥接的对比量化,将查询-物品交互监督注入残差量化,主动学习与相关性感知的语义分区;在查询端利用生成式大模型直接从文本预测物品SID,解决尾部查询与意图模糊问题。查询与物品SID之间的分层前缀匹配生成判别性特征,完美补充密集信号。在天猫生产数据上的大量实验表明,该方法离线AUC提升+1.54%。通过高效混合架构部署,线上点击率提升+0.13%,转化率提升+0.25%,验证其巨大工业价值。
原文摘要 · Abstract (English)
Despite rapid progress of continuous embeddings for e-commerce search relevance, a long-standing open problem is the difficulty in capturing fine-grained attribute distinctions. While discrete Semantic Identifiers (SIDs) have been widely adopted as a promising alternative, existing SID generation methods rely heavily on unsupervised quantization. In realistic scenarios, the lack of explicit supervision often makes it more difficult to dictate which items should share an SID, resulting in limited capability for query-dependent ranking. To address the issue of unsupervised SIDs, we propose to explicitly model discrete relevance features and develop a Discrete Semantic Identifier Relevance Model (DSIRM). Specifically, we present a query-bridged contrastive quantization approach on the item side, injecting query-item interaction supervision into Residual Quantization to actively learn relevance-aware semantic partitions. On the other hand, we explore generative LLMs on the query side to explicitly predict item SIDs from text, resolving tail queries and intent ambiguity. Hierarchical prefix matching between query and item SIDs yields discriminative features that perfectly complement dense signals. Extensive experimental results on Tmall's production data show that our proposed approach has achieved better results, improving offline AUC by +1.54\%. Deployed via an efficient hybrid architecture, it achieves significant online lifts (+0.13\% UCTR, +0.25\% UCTCVR), proving its massive industrial value.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。