arXiv:2509.20904cs.IR2025-09KDD被引 33

提出新方法生成更有效的语义标识,提升工业级推荐系统效果

FORGE: Forming Semantic Identifiers for Generative Retrieval in Industrial Datasets

论文配图:FORGE: Forming Semantic Identifiers for Generative Retrieval in Industrial Datasets
图 1 · 摘自论文原文
  • 构建语义标识的系统化策略并验证其对推荐的影响
  • 线上实验提升淘宝猜你喜欢交易量0.35%
  • 设计无需训练的评估指标,加速标识优化

语义标识(SIDs)因其语义区分能力在生成式推荐中日益受到关注。然而现有研究主要存在两点不足:(1)对构建优质SIDs的策略探索有限;(2)评估SIDs需依赖昂贵的生成式推荐训练。为此,我们提出FORGE,一个面向生成式推荐中语义标识构建的综合性基准。FORGE从多角度梳理了SID构建流程,并通过离线实验验证其对下游推荐性能的影响。显著成果是,在淘宝“猜你喜欢”模块的线上A/B测试中,该方法使交易量提升0.35%。相关策略已全量部署于淘宝。为避免耗时的完整训练评估,我们提出两个与推荐性能高度相关的新型评估指标,可实现无训练条件下的便捷评估。此外,我们公开了工业级数据集AL-GR,包含140亿条交互记录和2.5亿个商品,附带多模态特征,数据与代码已开源至https://github.com/selous123/al_sid。

原文摘要 · Abstract (English)

Semantic identifiers (SIDs) have gained increasing attention in generative retrieval (GR) for recommendation due to their meaningful semantic discriminability. However, current studies in this field primarily (1) offer limited investigation into the construction strategies for better SIDs, and (2) their SID assessment typically relies on costly GR training. To address these challenges, we propose FORGE, a comprehensive benchmark for FOrming semantic identifieRs for Generative rEtrieval. Specifically, FORGE provides a taxonomy of the SID construction process from several perspectives and validates their impact on downstream GR through offline experiments across diverse settings. Notably, these empirical findings have led to a 0.35% increase in transaction count via online A/B experiments in the Guess You Like section of Taobao. The corresponding SID construction strategies have since been deployed at full scale on Taobao, demonstrating their practical effectiveness. To avoid expensive SID assessment that requires full GR training, we propose two novel SID evaluation metrics that are highly correlated with recommendation performance, enabling convenient evaluations without any GR training. Furthermore, to facilitate the community, we release AL-GR, the industrial dataset used in our experiments, comprising 14 billion interactions and 250 million items with the corresponding multimodal features collected from Taobao. All the code and data are available at https://github.com/selous123/al_sid.

生成式推荐语义标识工业数据评估指标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。