通过对齐物品ID与内容特征,提升长序列推荐效果。
Self-Supervised Representation Learning with ID-Content Modality Alignment for Sequential Recommendation
- 用大模型构建样本,统一不同内容模态表示
- 双编码器融合行为与内容偏好,提升推荐精度
- 分步训练策略让内容与用户行为解耦学习
序列推荐模型通常依赖历史交互的物品ID来捕捉用户偏好,但在交互历史有限时表现不佳。基于内容的序列推荐利用物品的文本和视觉特征来增强偏好学习,但仍面临三大挑战:(i) 减少不同内容模态表示间的语义差距;(ii) 联合建模用户行为偏好与内容偏好;(iii) 设计有效的训练策略以对齐ID表示与内容表示。为此,我们提出SICSRec模型:首先,采用基于大语言模型的样本构造方法,并通过监督微调对齐物品级模态表示;其次,设计一种新型Transformer架构,其中ID模态编码器捕捉用户行为偏好,内容模态编码器学习用户内容偏好,混合模态解码器建模两者内在关联;最后,提出两阶段训练策略,结合内容感知对比学习任务,实现模态表示与ID表示对齐,同时解耦内容依赖与协同过滤依赖的训练过程。在四个公开视频流数据集上的实验表明,SICSRec在NDCG@5上平均优于现有ID模态与内容模态推荐模型8.04%和6.62%。
原文摘要 · Abstract (English)
Sequential recommendation (SR) models often capture user preferences based on the historically interacted item IDs, which usually obtain sub-optimal performance when the interaction history is limited. Content-based sequential recommendation has recently emerged as a promising direction that exploits items' textual and visual features to enhance preference learning. However, there are still three key challenges: (i) how to reduce the semantic gap between different content modality representations; (ii) how to jointly model user behavior preferences and content preferences; and (iii) how to design an effective training strategy to align ID representations and content representations. To address these challenges, we propose a novel model, self-supervised representation learning with ID-Content modality alignment, named SICSRec. Firstly, we propose a LLM-driven sample construction method and develop a supervised fine-tuning approach to align item-level modality representations. Secondly, we design a novel Transformer-based sequential model, where an ID-modality sequence encoder captures user behavior preferences, a content-modality sequence encoder learns user content preferences, and a mix-modality sequence decoder grasps the intrinsic relationship between these two types of preferences. Thirdly, we propose a two-step training strategy with a content-aware contrastive learning task to align modality representations and ID representations, which decouples the training process of content modality dependency and item collaborative dependency. Extensive experiments conducted on four public video streaming datasets demonstrate our SICSRec outperforms the state-of-the-art ID-modality sequential recommenders and content-modality sequential recommenders by 8.04% on NDCG@5 and 6.62% on NDCD@10 on average, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。