arXiv:2504.10541cs.IRcs.AI2025-04被引 4

用超图增强大模型推荐能力,融合用户兴趣与物品关联

Multi-Modal Hypergraph Enhanced LLM Learning for Recommendation

  • 构建用户和物品超图,捕捉多视角高阶语义关系
  • 在预训练中通过超图卷积与对比学习提升表示区分度
  • 将超图嵌入注入大模型,结合行为序列建模时空动态

大型语言模型(LLM)正推动个性化推荐系统的发展。现有基于LLM的方法未能充分挖掘推荐场景中的多视图图结构关联。为此,我们提出一种新框架HeLLM,通过融合图级上下文信号与序列级行为模式,使LLM具备捕捉复杂高阶语义关联的能力。在推荐预训练阶段,设计用户超图以揭示用户间共享兴趣偏好,物品超图用于捕获物品间的多模态相似性关联。引入超图卷积与协同对比学习机制,增强学习表征的可区分性。在LLM微调阶段,将学习到的图结构嵌入直接注入模型架构,并融合捕捉用户历史行为的序列特征。该过程使超图作为全局上下文,提升LLM对复杂关系模式的感知能力,同时建模局部时间动态。大量实验表明,所提方法优于当前最优基线,验证了超图上下文与序列行为融合在推荐任务中的优势。

原文摘要 · Abstract (English)

The burgeoning presence of Large Language Models (LLM) is propelling the development of personalized recommender systems. Most existing LLM-based methods fail to sufficiently explore the multi-view graph structure correlations inherent in recommendation scenarios. To this end, we propose a novel framework, Hypergraph Enhanced LLM Learning for multimodal Recommendation (HeLLM), designed to equip LLMs with the capability to capture intricate higher-order semantic correlations by fusing graph-level contextual signals with sequence-level behavioral patterns. In the recommender pre-training phase, we design a user hypergraph to uncover shared interest preferences among users and an item hypergraph to capture correlations within multimodal similarities among items. The hypergraph convolution and synergistic contrastive learning mechanism are introduced to enhance the distinguishability of learned representations. In the LLM fine-tuning phase, we inject the learned graph-structured embeddings directly into the LLM's architecture and integrate sequential features capturing each user's chronological behavior. This process enables hypergraphs to leverage graph-structured information as global context, enhancing the LLM's ability to perceive complex relational patterns and integrate multimodal information, while also modeling local temporal dynamics. Extensive experiments demonstrate the superiority of our proposed method over state-of-the-art baselines, confirming the advantages of fusing hypergraph-based context with sequential user behavior in LLMs for recommendation.

推荐系统超图大模型多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。