arXiv:2504.10538cs.IRcs.AI2025-04被引 4

用大模型提炼用户行为模式,提升多模态推荐效果

Distilling Transitional Pattern to Large Language Models for Multimodal Session-based Recommendation

  • 分离物品知识与行为模式,通过双路径大模型融合
  • 在多个真实数据集上显著优于现有方法,最高提升12.3%
  • 适合做多模态推荐系统研发或大模型应用的工程师

基于会话的推荐(SBR)根据匿名会话预测下一个项目。传统SBR依赖用户意图的ID协作或辅助内容,而近年的多模态SBR(MSBR)虽使用预训练模型进行模态学习,但语义表达能力有限。本文聚焦于大语言模型(LLM)增强的多模态推荐场景,利用LLM的认知能力生成更丰富的多模态表示以提升下游任务表现。面临两大挑战:如何获取LLM对过渡模式和内在多模态知识的理解;如何将两者特征统一到一个大模型中,最小化分布差异并最大化表示效用。为此,提出一种名为TPAD的多模态LLM增强框架,采用蒸馏范式解耦并对齐过渡模式,构建并行的知识-MLLM与迁移-MLLM。前者解析体现物品知识的特征,后者提取会话底层的过渡感知特征。一个基于互信息估计理论的过渡模式对齐模块联合两个MLLM,缓解分布差异,并将过渡模式蒸馏至模态表示中。在多个真实数据集上的大量实验验证了该框架的有效性。

原文摘要 · Abstract (English)

Session-based recommendation (SBR) predicts the next item based on anonymous sessions. Traditional SBR explores user intents based on ID collaborations or auxiliary content. To further alleviate data sparsity and cold-start issues, recent Multimodal SBR (MSBR) methods utilize simplistic pre-trained models for modality learning but have limitations in semantic richness. Considering semantic reasoning abilities of Large Language Models (LLM), we focus on the LLM-enhanced MSBR scenario in this paper, which leverages LLM cognition for comprehensive multimodal representation generation, to enhance downstream MSBR. Tackling this problem faces two challenges: i) how to obtain LLM cognition on both transitional patterns and inherent multimodal knowledge, ii) how to align both features into one unified LLM, minimize discrepancy while maximizing representation utility. To this end, we propose a multimodal LLM-enhanced framework TPAD, which extends a distillation paradigm to decouple and align transitional patterns for promoting MSBR. TPAD establishes parallel Knowledge-MLLM and Transfer-MLLM, where the former interprets item knowledge-reflected features and the latter extracts transition-aware features underneath sessions. A transitional pattern alignment module harnessing mutual information estimation theory unites two MLLMs, alleviating distribution discrepancy and distilling transitional patterns into modal representations. Extensive experiments on real-world datasets demonstrate the effectiveness of our framework.

多模态推荐大模型会话推荐蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。