arXiv:2511.01461cs.IR2025-11中稿 · WSDM'26被引 8

电商生成式检索中,用分类树信息提升文档标识符的表达力。

CAT-ID$^2$: Category-Tree Integrated Document Identifier Learning for Generative Retrieval In E-commerce

  • 引入分类树层级约束损失,将类别信息逐步融入文档标识符。
  • 在线实验显示,模糊意图查询下单率提升0.33%,长尾查询提升0.24%。
  • 适合需要高精度语义匹配的电商检索场景,尤其关注类别结构的系统。

生成式检索(GR)作为融合大语言模型能力的有效范式,通常包含两个阶段:为文档构建离散语义标识符(ID),并通过自回归生成ID token实现文档检索。其核心挑战在于如何构建具有强表征能力的文档ID(DocIDs)。理想的ID应具备两个特性:相似文档的ID更接近,且每篇文档拥有独特且可区分的标识。然而,现有方法普遍忽略电商环境中普遍存在且关键的类别信息。为此,本文提出一种新型ID学习方法——分类树集成文档标识符(CAT-ID²),将先验类别信息融入语义ID。CAT-ID²包含三个关键模块:层次化类别约束损失,在量化过程中逐层整合类别信息;聚类规模约束损失,保证ID token分布均匀;分散损失,提升重建文档间的区分度。该方法使相似文档的标识更相近,同时保持不同文档表示的独特性。大量离线与在线实验验证其有效性,线上A/B测试显示,对于模糊意图查询,平均每千用户订单数提升0.33%;对于长尾查询,提升0.24%。

原文摘要 · Abstract (English)

Generative retrieval (GR) has gained significant attention as an effective paradigm that integrates the capabilities of large language models (LLMs). It generally consists of two stages: constructing discrete semantic identifiers (IDs) for documents and retrieving documents by autoregressively generating ID tokens. The core challenge in GR is how to construct document IDs (DocIDS) with strong representational power. Good IDs should exhibit two key properties: similar documents should have more similar IDs, and each document should maintain a distinct and unique ID. However, most existing methods ignore native category information, which is common and critical in E-commerce. Therefore, we propose a novel ID learning method, CAtegory-Tree Integrated Document IDentifier (CAT-ID$^2$), incorporating prior category information into the semantic IDs. CAT-ID$^2$ includes three key modules: a Hierarchical Class Constraint Loss to integrate category information layer by layer during quantization, a Cluster Scale Constraint Loss for uniform ID token distribution, and a Dispersion Loss to improve the distinction of reconstructed documents. These components enable CAT-ID$^2$ to generate IDs that make similar documents more alike while preserving the uniqueness of different documents' representations. Extensive offline and online experiments confirm the effectiveness of our method, with online A/B tests showing a 0.33% increase in average orders per thousand users for ambiguous intent queries and 0.24% for long-tail queries.

生成检索电商分类树标识符学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。