不依赖用户、ID和图神经网络,实现高效推荐
AlphaFree: Recommendation Free from Users, IDs, and GNNs
- 不用用户嵌入,通过语言模型生成的文本表示替代原始ID
- 在多个数据集上相比基线提升最高达40%,内存降低69%
- 适合关注低存储开销与冷启动问题的研究者
推荐系统在个性化内容分发中至关重要,顶K物品推荐是核心任务。现有方法普遍依赖用户嵌入(用户相关)、原始ID初始化(ID相关)和图神经网络(GNN相关),导致高内存消耗、冷启动和过平滑问题,且对未见交互泛化能力差。本文提出AlphaFree,一种摆脱用户、ID和GNN的新型推荐方法:通过即时推断偏好实现无用户依赖,用预训练语言模型生成的语言表示(LRs)替代原始ID实现无ID依赖,并借助相似物品增强与对比学习捕捉协同信号,无需GNN。在多个真实数据集上的实验表明,AlphaFree持续优于基线方法,在非LR方法上最高提升约40%,在LR方法上最高提升5.7%,同时在高维LR下GPU内存使用减少高达69%。
原文摘要 · Abstract (English)
Can we design effective recommender systems free from users, IDs, and GNNs? Recommender systems are central to personalized content delivery across domains, with top-K item recommendation being a fundamental task to retrieve the most relevant items from historical interactions. Existing methods rely on entrenched design conventions, often adopted without reconsideration, such as storing per-user embeddings (user-dependent), initializing features from raw IDs (ID-dependent), and employing graph neural networks (GNN-dependent). These dependencies incur several limitations, including high memory costs, cold-start and over-smoothing issues, and poor generalization to unseen interactions. In this work, we propose AlphaFree, a novel recommendation method free from users, IDs, and GNNs. Our main ideas are to infer preferences on-the-fly without user embeddings (user-free), replace raw IDs with language representations (LRs) from pre-trained language models (ID-free), and capture collaborative signals through augmentation with similar items and contrastive learning, without GNNs (GNN-free). Extensive experiments on various real-world datasets show that AlphaFree consistently outperforms its competitors, achieving up to around 40% improvements over non-LR-based methods and up to 5.7% improvements over LR-based methods, while significantly reducing GPU memory usage by up to 69% under high-dimensional LRs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。