融合物品标识与语义特征,提升推荐系统泛化能力。
Unified Semantic and ID Representation Learning for Deep Recommenders
- 用标识符捕捉独特属性,语义符表示共享特征,互补增强表征。
- 在三个数据集上性能提升6%至17%,令牌规模减少超80%。
- 适合关注冷启动与模型轻量化的推荐系统研究者。
有效推荐对大规模在线平台至关重要。传统推荐系统主要依赖唯一标识符(ID tokens)识别物品,虽能捕捉特定物品关系,但存在冗余及冷启动表现差等问题。近期方法尝试使用语义标识符替代,却面临物品重复和性能不稳定等挑战,语义标识符的优势尚未充分挖掘。为此,本文提出统一的语义与ID表示学习框架,利用两类标记的互补优势:ID标记捕捉物品独特属性,语义标记表达共享可迁移特征。同时,分析余弦相似度与欧氏距离在嵌入搜索中的作用,发现余弦相似度更优用于解耦累积嵌入,欧氏距离则更擅长区分独特物品。因此,在模型前层采用余弦相似度,末层使用欧氏距离,以优化表示学习。在三个基准数据集上的实验表明,本方法显著优于现有最优基线,性能提升6%至17%,令牌大小减少超过80%。结果证明,结合ID与语义标记能有效提升推荐系统的泛化能力。
原文摘要 · Abstract (English)
Effective recommendation is crucial for large-scale online platforms. Traditional recommendation systems primarily rely on ID tokens to uniquely identify items, which can effectively capture specific item relationships but suffer from issues such as redundancy and poor performance in cold-start scenarios. Recent approaches have explored using semantic tokens as an alternative, yet they face challenges, including item duplication and inconsistent performance gains, leaving the potential advantages of semantic tokens inadequately examined. To address these limitations, we propose a Unified Semantic and ID Representation Learning framework that leverages the complementary strengths of both token types. In our framework, ID tokens capture unique item attributes, while semantic tokens represent shared, transferable characteristics. Additionally, we analyze the role of cosine similarity and Euclidean distance in embedding search, revealing that cosine similarity is more effective in decoupling accumulated embeddings, while Euclidean distance excels in distinguishing unique items. Our framework integrates cosine similarity in earlier layers and Euclidean distance in the final layer to optimize representation learning. Experiments on three benchmark datasets show that our method significantly outperforms state-of-the-art baselines, with improvements ranging from 6\% to 17\% and a reduction in token size by over 80%. These results demonstrate the effectiveness of combining ID and semantic tokenization to enhance the generalization ability of recommender systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。