用微调增量保留内容特征,解决冷启动商品推荐效果差的问题
Let It Go? Not Quite: Addressing Item Cold Start in Sequential Recommendations with Content-Based Initialization
- 给冻结的内容嵌入加小量可训练增量,实现适度适应
- 在电商和音乐数据集上均显著提升冷启动项推荐准确率
- 适合新商品多、文本/音频内容丰富的推荐场景
许多序列推荐系统面临冷启动问题:交互稀疏的新商品因缺乏训练过的嵌入而难以被模型有效利用。传统基于内容的方法常使用文本描述等元数据生成的嵌入作为初始化。然而,直接冻结这些嵌入会限制模型适应性,而过度微调又会导致商品表示偏离原始语义结构。本文提出一种新方法:在冻结内容嵌入基础上添加一个小型可训练增量,使模型能在不偏离原语义的前提下自适应调整。该方法在包含文本描述的电商数据集和基于音频表示的音乐数据集上均取得一致改进,验证了其有效性与泛化能力。
原文摘要 · Abstract (English)
Many sequential recommender systems suffer from the cold start problem, where items with few or no interactions cannot be effectively used by the model due to the absence of a trained embedding. Content-based approaches, which leverage item metadata, are commonly used in such scenarios. One possible way is to use embeddings derived from content features such as textual descriptions as initialization for the model embeddings. However, directly using frozen content embeddings often results in suboptimal performance, as they may not fully adapt to the recommendation task. On the other hand, fine-tuning these embeddings can degrade performance for cold-start items, as item representations may drift far from their original structure after training. We propose a novel approach to address this limitation. Instead of entirely freezing the content embeddings or fine-tuning them extensively, we introduce a small trainable delta to frozen embeddings that enables the model to adapt item representations without letting them go too far from their original semantic structure. This approach demonstrates consistent improvements across multiple datasets and modalities, including e-commerce datasets with textual descriptions and a music dataset with audio-based representation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。