arXiv:2608.30606cs.IRcs.AI2026-08

联合训练嵌入与码本,提升电商检索准确率

Generative Retrieval for E-commerce: Jointly Learning Embedding and Codebook with Same Product Cluster

  • 嵌入模型与码本联合训练,避免误差累积
  • 引入同品类产品聚类信息作为监督信号
  • 适合追求高精度商品检索的系统开发者

随着大语言模型的发展,生成式检索在电商场景中日益重要。当前主流方法采用两阶段训练:先训练商品嵌入模型,再学习将嵌入映射到商品ID的码本。该级联策略存在两大问题:(1) 误差累积——若第一阶段嵌入模型产生偏差表示,第二阶段码本无法纠正,导致最终检索性能下降;(2) 码本学习仅依赖商品嵌入,缺乏查询到商品及商品间交互建模。因此,同一聚类中的商品可能被分配不一致的ID,进一步损害检索准确性。为解决这些问题,我们提出一种新方法,联合训练嵌入模型与码本,并引入同品类产品聚类信息作为额外监督信号。实验表明,该方法显著提升了电商检索性能,同时增强了嵌入与码本的学习效果。

原文摘要 · Abstract (English)

With the development of large language models (LLMs), generative retrieval is becoming increasingly important in e-commerce scenarios. Current mainstream approaches typically use a two-stage training strategy: first train a product embedding model, and then learn a codebook that maps embeddings to product IDs. This cascaded approach suffers from two major issues: (1) error accumulation-if the embedding model in the first stage produces biased representations, the codebook in the second stage cannot correct these errors, degrading final retrieval performance; and (2) codebook learning relies solely on product embeddings and lacks modeling of query-to-product and product-to-product interactions. As a result, products belonging to the same cluster may be assigned inconsistent IDs by the codebook, further hurting retrieval accuracy. To address these problems, we propose a novel method that jointly trains the embedding model and the codebook, and incorporates same product cluster information as an additional supervision signal. Experimental results demonstrate that our method significantly improves e-commerce retrieval performance while simultaneously enhancing both embedding and codebook learning.

电商检索嵌入学习联合训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。