用大模型融合文本与行为数据,提升推荐系统的意图理解能力
Intent Representation Learning with Large Language Model for Recommendation
- 用双塔结构学习文本和交互的多模态意图表示
- 通过成对对齐和动量蒸馏,提升跨模态意图匹配效果
- 在三个数据集上超越基线,适合需要可解释推荐的场景
基于意图的推荐系统因能挖掘细粒度用户偏好而受到关注。意图作为交互背后的潜在因素,对提升推荐可解释性至关重要。现有方法通常将意图定义为随交互更新的可学习参数,但往往忽略用户评论、商品描述等文本信息,导致意图稀疏问题。如何对齐多模态意图并缓解噪声,以及如何跨模态提取匹配潜在关键意图,是两大挑战。为此,我们提出一种模型无关框架IRLLRec,利用大语言模型(LLMs)构建多模态意图并增强推荐。具体地,IRLLRec采用双塔架构学习多模态意图表示,提出成对对齐与翻译对齐以消除模态间差异并增强鲁棒性;最后通过动量蒸馏,在融合意图表示上实现教师-学生学习,更好匹配文本与交互意图。在三个数据集上的实证评估表明,该框架优于基线方法。代码已开源。
原文摘要 · Abstract (English)
Intent-based recommender systems have garnered significant attention for uncovering latent fine-grained preferences. Intents, as underlying factors of interactions, are crucial for improving recommendation interpretability. Most methods define intents as learnable parameters updated alongside interactions. However, existing frameworks often overlook textual information (e.g., user reviews, item descriptions), which is crucial for alleviating the sparsity of interaction intents. Exploring these multimodal intents, especially the inherent differences in representation spaces, poses two key challenges: i) How to align multimodal intents and effectively mitigate noise issues; ii) How to extract and match latent key intents across modalities. To tackle these challenges, we propose a model-agnostic framework, Intent Representation Learning with Large Language Model (IRLLRec), which leverages large language models (LLMs) to construct multimodal intents and enhance recommendations. Specifically, IRLLRec employs a dual-tower architecture to learn multimodal intent representations. Next, we propose pairwise and translation alignment to eliminate inter-modal differences and enhance robustness against noisy input features. Finally, to better match textual and interaction-based intents, we employ momentum distillation to perform teacher-student learning on fused intent representations. Empirical evaluations on three datasets show that our IRLLRec framework outperforms baselines.Code available at https://github.com/wangyu0627/IRLLRec.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。