用稀疏表示提升冷启动商品推荐效果,存得少、算得快、更准确。
Learning Sparse Representations of Multimodal Content for Enhanced Cold Item Recommendation

- 用稀疏嵌入替代稠密向量,降低存储与检索开销。
- 在4个数据集上,冷启动推荐准确率显著高于稠密嵌入。
- 适合需要高效处理多兴趣用户和海量新品的推荐系统。
现代数字平台的商品目录规模庞大且增长迅速,给推荐系统带来挑战。现有系统依赖嵌入相似性预测用户偏好,但工业级目录下嵌入存储与低延迟检索困难。新加入的商品缺乏对应嵌入,难以有效推荐。以往工作常通过图像、文本等辅助内容生成冷启动商品表示,以预测用户偏好。本文认为,在基于内容的冷启动范式中,稀疏嵌入相比标准稠密向量具有显著优势。我们阐述如何将现有冷启动训练策略适配于稀疏表示学习,并借鉴线性注意力思想设计预稀疏化激活技术,使学习到的商品-商品相似性具备锐化与去噪效果。实验表明,所获稀疏嵌入在冷启动推荐准确率上优于稠密嵌入,且存储成本大幅降低,尤其对多兴趣用户表现更佳。在四个多模态推荐数据集上的全面实验还验证了稀疏内容嵌入的可解释性及其在大小与精度权衡中的鲁棒性。
原文摘要 · Abstract (English)
The scale and rapid growth of item catalogs in modern digital platforms present significant challenges to recommender system (RS) practitioners. Most RSs use embedding similarity to predict user-item preferences, but embedding storage and low-latency retrieval are challenging in industry-scale catalogs. Furthermore, newly added items do not have corresponding embeddings and cannot be recommended effectively; previous works often tackle this item cold-start problem by generating cold item representations from auxiliary content, such as images or descriptive text, so that user preferences can be predicted without historical interactions. In this paper, we argue that sparse embeddings have notable advantages over standard dense vectors in this content-based cold-start paradigm. We describe how existing cold-start training regimes can be adapted for sparse representation learning, and build on insights from linear attention to design a pre-sparsification activation technique that induces sharpness and denoising effects in learned item-item similarities. We show that the resulting sparse embeddings achieve significant improvements in cold-start recommendation accuracy over dense embeddings at considerably lower storage costs, especially for users with multiple interests. Through comprehensive experiments on four multimodal RS datasets, we also demonstrate the interpretability of sparse content embeddings and their robustness in the trade-off between size and accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。