arXiv:2505.12396cs.IR2025-05被引 8

用大模型思维链生成语义ID,提升推荐系统信息密度与长尾效果。

LLM-CoT Enhanced Graph Neural Recommendation with Harmonized Group Policy Optimization

  • 用大模型思维链生成语义ID,增强表示的语义质量
  • 提出HGPO算法动态优化负样本与温度系数,提升对比学习效果
  • 适合关注长尾推荐与大模型融合的系统设计者

图神经网络在建模用户-物品交互关系方面推动了推荐系统的发展。然而,现有基于图的推荐系统依赖稀疏的ID特征,未能充分挖掘文本信息,导致表征信息密度低。此外,图对比学习面临挑战:随机负采样可能引入错误负样本,而固定温度系数无法适应不同节点的异质性。当前利用大语言模型(LLMs)增强推荐的研究尚未充分发挥其思维链(CoT)推理能力来指导表征学习。为此,本文提出LGHRec(LLM-CoT增强的图神经推荐与协调组策略优化)。该框架利用大模型的思维链推理生成语义ID,丰富推理过程,提升表征的信息密度和语义质量。同时,设计了一种强化学习算法——协调组策略优化(HGPO),用于优化对比学习中的负采样策略与温度系数,增强长尾推荐性能并确保不同群体间优化的一致性。三个数据集上的实验表明,LGHRec通过大模型生成的语义ID提升了表征质量,并借助HGPO有效改进了对比学习,优于多个基线模型。

原文摘要 · Abstract (English)

Graph neural networks (GNNs) have advanced recommender systems by modeling interaction relationships. However, existing graph-based recommenders rely on sparse ID features and do not fully exploit textual information, resulting in low information density within representations. Furthermore, graph contrastive learning faces challenges. Random negative sampling can introduce false negative samples, while fixed temperature coefficients cannot adapt to the heterogeneity of different nodes. In addition, current efforts to enhance recommendations with large language models (LLMs) have not fully utilized their Chain-of-Thought (CoT) reasoning capabilities to guide representation learning. To address these limitations, we introduces LGHRec (LLM-CoT Enhanced Graph Neural Recommendation with Harmonized Group Policy Optimization). This framework leverages the CoT reasoning ability of LLMs to generate semantic IDs, enriching reasoning processes and improving information density and semantic quality of representations. Moreover, we design a reinforcement learning algorithm, Harmonized Group Policy Optimization (HGPO), to optimize negative sampling strategies and temperature coefficients in contrastive learning. This approach enhances long-tail recommendation performance and ensures optimization consistency across different groups. Experimental results on three datasets demonstrate that LGHRec improves representation quality through semantic IDs generated by LLM's CoT reasoning and effectively boosts contrastive learning with HGPO. Our method outperforms several baseline models. The code is available at: https://anonymous.4open.science/r/LLM-Rec.

推荐系统大模型图神经网络对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。