arXiv:2502.06269cs.IR2025-02中稿 · TOIS 2025被引 18

统一语义与协同信息生成推荐码,提升生成式推荐效果

UNGER: Generative Recommendation with A Unified Code via Semantic and Collaborative Integration

  • 通过联合优化跨模态对齐与下一物品预测,自适应融合双模态嵌入
  • 在三个基准数据集上优于现有方法,有效缓解量化带来的信息损失
  • 适合关注生成式推荐中多模态融合的科研与工程人员

随着生成范式的兴起,生成式推荐受到越来越多关注。核心组件是物品编码,通常通过量化协同或语义表示得到,用作上下文中的候选物品标识。然而,现有方法通常为每种模态单独构建编码,导致计算与存储成本上升,并阻碍了模态间互补优势的整合。针对这一问题,我们提出将两种不同模态整合为统一编码,充分释放模态间的互补潜力。然而,这种整合仍具挑战:通过常规拼接获得的集成嵌入会导致协同知识利用不足,从而影响效果。为此,我们提出一种新方法 UNGER,将语义与协同知识整合至统一编码中用于生成式推荐。具体而言,通过联合优化跨模态知识对齐与下一物品预测任务,自适应学习集成嵌入;随后,为缓解量化过程中的信息损失,引入同模态知识蒸馏任务,以集成嵌入作为监督信号进行补偿。在三个广泛使用的基准数据集上的大量实验表明,该方法显著优于现有方法。

原文摘要 · Abstract (English)

With the rise of generative paradigms, generative recommendation has garnered increasing attention. The core component is the item code, generally derived by quantizing collaborative or semantic representations to serve as candidate items identifiers in the context. However, existing methods typically construct separate codes for each modality, leading to higher computational and storage costs and hindering the integration of their complementary strengths. Considering this limitation, we seek to integrate two different modalities into a unified code, fully unleashing the potential of complementary nature among modalities. Nevertheless, the integration remains challenging: the integrated embedding obtained by the common concatenation method would lead to underutilization of collaborative knowledge, thereby resulting in limited effectiveness. To address this, we propose a novel method, named UNGER, which integrates semantic and collaborative knowledge into a unified code for generative recommendation. Specifically, we propose to adaptively learn an integrated embedding through the joint optimization of cross-modality knowledge alignment and next item prediction tasks. Subsequently, to mitigate the information loss caused by the quantization process, we introduce an intra-modality knowledge distillation task, using the integrated embeddings as supervised signals to compensate. Extensive experiments on three widely used benchmarks demonstrate the superiority of our approach compared to existing methods.

生成推荐多模态融合统一编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。