用流模型将物品嵌入转为独立标准正态分布,提升推荐效果与冷启动表现
Tlow: Flow-based Item Tokenizer for Recommendation

- 通过流模型将语义嵌入转换为独立且标准正态分布的潜空间
- 在4个公开数据集上提升推荐性能,新物品点击率提升11.64%
- 适合追求高效、可解释性推荐系统的研究者与工程师
物品分词器将语义嵌入编码为令牌ID,替代传统推荐模型中随机分配的物品ID,从根本上缓解参数过多和冷启动问题。然而,主流分词器RQ-VAE因码本间存在固有依赖,解码效率低;而高效独立分词器如优化产品量化(OPQ)仍受语义嵌入维度相关性和分布复杂性制约。本文提出基于流的物品分词器Tlow,将原始语义嵌入映射到潜空间,使其服从统一标准正态分布,实现维度独立与分布简化双重优势。在此潜空间上进行独立分词,生成语义清晰的令牌ID。此外,引入新型码本引导机制,使码本空间与令牌嵌入空间对齐,进一步促进语义区分度高的令牌嵌入学习。离线实验在四个公开数据集上验证,Tlow的分词与码本引导显著提升推荐性能;跨域与多模态推荐结果证明其在简化嵌入空间中的有效性。在线实验在微信平台多模态检索任务中验证,基于令牌ID的检索模型全局用户点击率提升10.32%,新物品点击率提升11.64%。代码已开源。
原文摘要 · Abstract (English)
Item tokenizer encodes semantic embeddings into token IDs to replace the randomly assigned item IDs used in traditional recommendation models, fundamentally addressing the problems of excessive parameters and cold starts. However, the most common tokenizer, RQ-VAE, suffers from low decoding efficiency due to the inherent dependencies among its codebooks. Meanwhile, efficient independent tokenizers such as optimized product quantization (OPQ) still struggle with dimensional correlations and distribution complexity of semantic embeddings. In this work, we propose a f\underline{low}-based item \underline{T}okenizer (Tlow) to transform raw semantic embeddings into a latent space where embeddings conform to a unified standard normal distribution, achieving dual advantages of dimensional independence and distributional simplicity. Independent tokenization performed on these latent embeddings yields semantically clear token IDs. Additionally, we introduce a novel codebook guidance to align the codebook space with the token embedding space, further aiding the learning of more semantically distinct token embeddings. Offline experiments on four public datasets demonstrate that Tlow's tokenization and codebook guidance significantly improve recommendation performance. The improvement on cross-domain and multi-modal recommendations also proves the effectiveness of item tokenization in a simplified embedding space. Online experiments for a multi-modal retrieval task on China's largest social media platform WeChat validate Tlow's powerful distribution transformation capability. The retrieval model based on token IDs improves user CTR by 10.32\% globally and by 11.64\% for new items. Our codes are available at https://github.com/wjjln/Tlow.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。