通过量化与生成机制,实现多兴趣推荐的精准建模。
GemiRec: Interest Quantization and Generation for Multi-Interest Recommendation
- 用量化字典分离用户兴趣结构,避免兴趣坍缩。
- 通过生成模型捕捉用户潜在兴趣演化,提升推荐多样性。
- 已在工业场景部署,适合需要高精度多兴趣建模的系统。
多兴趣推荐在工业检索阶段受到关注,相比传统双塔方法,它生成多个用户表征以建模全面兴趣。然而现有方法存在两大局限:一是兴趣坍缩,多个表征趋于同质;二是难以捕捉历史行为中未体现的潜在兴趣演化。本文提出框架级改进方法 GemiRec,通过兴趣量化实现结构化兴趣分离,结合兴趣生成显式建模兴趣演化动态。该框架包含三个模块:(a) 兴趣字典维护模块(IDMM)维护共享量化兴趣字典;(b) 多兴趣后验分布模块(MIPDM)采用生成模型捕获用户未来兴趣分布;(c) 多兴趣检索模块(MIRM)使用多个用户兴趣表征进行项目召回。理论分析与大量实验验证了其有效性,且自2025年3月起已在生产环境部署,展现实际应用价值。
原文摘要 · Abstract (English)
Multi-interest recommendation has gained attention, especially in industrial retrieval stage. Unlike classical dual-tower methods, it generates multiple user representations instead of a single one to model comprehensive user interests. However, prior studies have identified two underlying limitations: the first is interest collapse, where multiple representations homogenize. The second is insufficient modeling of interest evolution, as they struggle to capture latent interests absent from a user's historical behavior. We begin with a thorough review of existing works in tackling these limitations. Then, we attempt to tackle these limitations from a new perspective. Specifically, we propose a framework-level refinement for multi-interest recommendation, named GemiRec. The proposed framework leverages interest quantization to enforce a structural interest separation and interest generation to learn the evolving dynamics of user interests explicitly. It comprises three modules: (a) Interest Dictionary Maintenance Module (IDMM) maintains a shared quantized interest dictionary. (b) Multi-Interest Posterior Distribution Module (MIPDM) employs a generative model to capture the distribution of user future interests. (c) Multi-Interest Retrieval Module (MIRM) retrieves items using multiple user-interest representations. Both theoretical and empirical analyses, as well as extensive experiments, demonstrate its advantages and effectiveness. Moreover, it has been deployed in production since March 2025, showing its practical value in industrial applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。