用位置感知的图变压器增强推荐系统的长程用户偏好建模
Position-aware Graph Transformer for Recommendation
- 引入位置编码显式捕捉图中节点的结构位置信息
- 结合Transformer全局建模与GCN局部特征提取,提升嵌入质量
- 在四个真实数据集上表现优异,尤其适合稀疏或噪声数据
协同推荐的核心在于从交互数据中学习高质量的用户和物品表示。近年来,图卷积网络(GCNs)通过利用交互图中的高阶连接模式推动了该领域的发展,如PinSage和LightGCN等先进方法。然而,现有方案尚未充分解决一个关键问题:捕捉长程协同过滤信号,这对建模用户偏好至关重要。本文提出一种新的图变压器框架——位置感知图变压器(PGTR),将Transformer块的全局建模能力与GCN的局部邻域特征提取相结合。其核心思想是通过专门设计的位置编码,显式地将用户-物品交互图中的节点位置和结构信息融入变压器架构。随后,通过线性组合的方式融合Transformer块的长程协同信号与GCN主干的局部邻域特征,以增强最终推荐所用的节点嵌入。实证研究表明,该方法在多种基于GCN的主干网络上,在四个真实世界数据集上均表现出显著有效性,并对交互稀疏性和噪声具有强鲁棒性。
原文摘要 · Abstract (English)
Collaborative recommendation fundamentally involves learning high-quality user and item representations from interaction data. Recently, graph convolution networks (GCNs) have advanced the field by utilizing high-order connectivity patterns in interaction graphs, as evidenced by state-of-the-art methods like PinSage and LightGCN. However, one key limitation has not been well addressed in existing solutions: capturing long-range collaborative filtering signals, which are crucial for modeling user preference. In this work, we propose a new graph transformer (GT) framework -- \textit{Position-aware Graph Transformer for Recommendation} (PGTR), which combines the global modeling capability of Transformer blocks with the local neighborhood feature extraction of GCNs. The key insight is to explicitly incorporate node position and structure information from the user-item interaction graph into GT architecture via several purpose-designed positional encodings. The long-range collaborative signals from the Transformer block are then combined linearly with the local neighborhood features from the GCN backbone to enhance node embeddings for final recommendations. Empirical studies demonstrate the effectiveness of the proposed PGTR method when implemented on various GCN-based backbones across four real-world datasets, and the robustness against interaction sparsity as well as noise.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。