用双重视角提取层次信息,让大模型推荐更准更快
Large Language Models Enhanced Hyperbolic Space Recommender Systems
- 从结构和语义双角度挖掘物品的层级标签
- 对比学习对齐用户-物品交互,性能提升超40%
- 适合追求高精度推荐与稳定训练的系统开发者
大语言模型(LLMs)因其卓越的世界知识能力在推荐系统中备受关注。然而,依赖欧氏空间的现有方法难以捕捉文本与语义数据中固有的丰富层次信息,而这对于理解用户偏好至关重要。双曲空间的几何特性为此提供了潜在解决方案。然而,将基于LLM的方法与双曲空间结合以有效提取并整合多样层次信息仍具挑战性。为此,我们提出一个模型无关的框架HyperLLM,从结构和语义两个层面提取并融合层次信息。结构上,利用LLM为每个物品生成具有父子关系的多级分类标签,并通过对比学习联合学习和对齐标签-物品及用户-物品交互,从而提供清晰的层次信息。语义上,引入一种新型元优化策略,从语义嵌入中提取层次信息,并弥合语义空间与协同空间之间的差距,实现无缝集成。大量实验表明,HyperLLM显著优于基于双曲空间和LLM的推荐系统,性能提升超过40%。此外,HyperLLM不仅提升推荐性能,还增强训练稳定性,凸显了层次信息在推荐系统中的关键作用。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have attracted significant attention in recommender systems for their excellent world knowledge capabilities. However, existing methods that rely on Euclidean space struggle to capture the rich hierarchical information inherent in textual and semantic data, which is essential for capturing user preferences. The geometric properties of hyperbolic space offer a promising solution to address this issue. Nevertheless, integrating LLMs-based methods with hyperbolic space to effectively extract and incorporate diverse hierarchical information is non-trivial. To this end, we propose a model-agnostic framework, named HyperLLM, which extracts and integrates hierarchical information from both structural and semantic perspectives. Structurally, HyperLLM uses LLMs to generate multi-level classification tags with hierarchical parent-child relationships for each item. Then, tag-item and user-item interactions are jointly learned and aligned through contrastive learning, thereby providing the model with clear hierarchical information. Semantically, HyperLLM introduces a novel meta-optimized strategy to extract hierarchical information from semantic embeddings and bridge the gap between the semantic and collaborative spaces for seamless integration. Extensive experiments show that HyperLLM significantly outperforms recommender systems based on hyperbolic space and LLMs, achieving performance improvements of over 40%. Furthermore, HyperLLM not only improves recommender performance but also enhances training stability, highlighting the critical role of hierarchical information in recommender systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。