arXiv:2510.26461cs.IRcs.LG2025-10被引 1

用大模型生成用户画像,提升冷启动推荐效果

Vectorized Context-Aware Embeddings for GAT-Based Collaborative Filtering

  • 用LLM生成用户画像和物品文本嵌入,注入图神经网络
  • 在两个数据集上均优于现有方法,尤其对低交互用户有效
  • 适合需要提升冷启动和稀疏场景推荐的系统设计者

推荐系统常受数据稀疏和冷启动问题困扰,难以对新用户或低频用户做出准确推荐。本文提出一种基于图注意力网络(GAT)的协同过滤框架,引入大语言模型(LLM)生成的上下文感知嵌入。具体地,通过生成简洁的文本用户画像,并将物品标题、类型、简介等元数据统一为丰富文本嵌入,作为二分图中节点的初始特征。为进一步优化排序性能,设计混合损失函数,结合贝叶斯个性化排序(BPR)与余弦相似度项,并采用鲁棒负采样策略,明确区分显式负反馈与未观察数据。在MovieLens 100k和1M数据集上的实验表明,本方法在精确率、NDCG和MAP指标上持续优于当前最优基线,且对交互历史有限的用户表现稳健。消融实验证实了LLM增强嵌入和余弦相似度项在捕捉细微语义关系中的关键作用。该方法通过将大模型的上下文理解融入图结构,有效缓解了稀疏性和冷启动问题。未来工作包括平衡推荐精度与覆盖率、多样性,引入公平性约束与可解释性功能。

原文摘要 · Abstract (English)

Recommender systems often struggle with data sparsity and cold-start scenarios, limiting their ability to provide accurate suggestions for new or infrequent users. This paper presents a Graph Attention Network (GAT) based Collaborative Filtering (CF) framework enhanced with Large Language Model (LLM) driven context aware embeddings. Specifically, we generate concise textual user profiles and unify item metadata (titles, genres, overviews) into rich textual embeddings, injecting these as initial node features in a bipartite user item graph. To further optimize ranking performance, we introduce a hybrid loss function that combines Bayesian Personalized Ranking (BPR) with a cosine similarity term and robust negative sampling, ensuring explicit negative feedback is distinguished from unobserved data. Experiments on the MovieLens 100k and 1M datasets show consistent improvements over state-of-the-art baselines in Precision, NDCG, and MAP while demonstrating robustness for users with limited interaction history. Ablation studies confirm the critical role of LLM-augmented embeddings and the cosine similarity term in capturing nuanced semantic relationships. Our approach effectively mitigates sparsity and cold-start limitations by integrating LLM-derived contextual understanding into graph-based architectures. Future directions include balancing recommendation accuracy with coverage and diversity, and introducing fairness-aware constraints and interpretability features to enhance system performance further.

推荐系统图神经网络大模型应用冷启动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。