arXiv:2412.17245cs.IRcs.SI2024-12被引 10

用用户-物品交互图聚类,大幅压缩推荐系统嵌入表大小

GraphHash: Graph Clustering Enables Parameter Efficiency in Recommender Systems

  • 基于双模图聚类将相似用户物品分组,共享嵌入向量
  • 嵌入表缩小75%以上时,召回率平均提升101.52%
  • 无需修改模型结构,可直接替代传统哈希方法

深度推荐系统依赖大型嵌入表处理高基数类别特征(如用户/物品标识符),在大规模场景下面临显著内存限制。为缓解此问题,常采用哈希技术将多个实体映射到同一嵌入以减小表规模。同时,基于图的协同信号在推荐系统中表现强劲,但其在优化嵌入表压缩方面的潜力尚未被探索。本文提出GraphHash,首个基于图的嵌入表压缩方法,通过在用户-物品交互图上进行基于模块度的双模图聚类来实现。我们证明模块度目标与消息传递存在理论关联,为方法提供理论基础。借助快速聚类算法,GraphHash在预处理阶段成为消息传递的高效代理,并作为即插即用的图基替代方案,优于传统ID哈希。大量实验表明,GraphHash在检索和点击率预测任务中显著超越多种哈希基线。尤其在嵌入表规模缩减超75%时,平均召回率提升101.52%,凸显图协同信息对模型压缩的价值。代码已开源:https://github.com/snap-research/GraphHash。

原文摘要 · Abstract (English)

Deep recommender systems rely heavily on large embedding tables to handle high-cardinality categorical features such as user/item identifiers, and face significant memory constraints at scale. To tackle this challenge, hashing techniques are often employed to map multiple entities to the same embedding and thus reduce the size of the embedding tables. Concurrently, graph-based collaborative signals have emerged as powerful tools in recommender systems, yet their potential for optimizing embedding table reduction remains unexplored. This paper introduces GraphHash, the first graph-based approach that leverages modularity-based bipartite graph clustering on user-item interaction graphs to reduce embedding table sizes. We demonstrate that the modularity objective has a theoretical connection to message-passing, which provides a foundation for our method. By employing fast clustering algorithms, GraphHash serves as a computationally efficient proxy for message-passing during preprocessing and a plug-and-play graph-based alternative to traditional ID hashing. Extensive experiments show that GraphHash substantially outperforms diverse hashing baselines on both retrieval and click-through-rate prediction tasks. In particular, GraphHash achieves on average a 101.52% improvement in recall when reducing the embedding table size by more than 75%, highlighting the value of graph-based collaborative information for model reduction. Our code is available at https://github.com/snap-research/GraphHash.

推荐系统图聚类嵌入压缩参数效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。