arXiv:2502.15331cs.IRcs.AI2025-02中稿 · TOIS at 20th Febru…被引 9

轻量高效序列推荐模型,用外部注意力和位置提示捕捉长期依赖。

Lightweight yet Efficient: An External Attentive Graph Convolutional Network with Positional Prompts for Sequential Recommendation

  • 用两个外部记忆单元线性计算节点间全局关联
  • 在5个真实数据集上超越现有方法,参数更少训练更省
  • 适合资源受限设备部署,尤其擅长处理长序列位置关系

基于图的序列推荐系统(GSRs)因其能同时建模用户-物品交互与物品间的序列关系而受到广泛关注。现有GSRs多采用复杂结构进行图编码(如图变压器),但计算开销大,难以在资源受限的边缘设备部署。此外,图变压器中的相对位置编码难以捕捉序列内部复杂的顺序依赖关系。为此,我们提出一种外部注意力图卷积网络与位置提示结合的序列推荐模型EA-GPS。首先,引入外部注意力图卷积网络,通过两个外部记忆单元线性度量节点间的全局关联;其次,设计基于位置提示的解码器,将绝对物品位置作为外部提示显式建模。结合长度自适应序列掩码与软注意力网络,该解码器有效捕捉长序列中的位置依赖与上下文关系。在五个真实数据集上的实验表明,所提模型显著优于当前最优方法,且参数量更小、训练开销更低。代码已开源:https://github.com/ZZY-GraphMiningLab/EA-GPS。

原文摘要 · Abstract (English)

Graph-based Sequential Recommender systems (GSRs) have gained significant research attention due to their ability to simultaneously handle user-item interactions and sequential relationships between items. Current GSRs often utilize composite or in-depth structures for graph encoding (e.g., the Graph Transformer). Nevertheless, they have high computational complexity, hindering the deployment on resource-constrained edge devices. Moreover, the relative position encoding in Graph Transformer has difficulty in considering the complicated positional dependencies within sequence. To this end, we propose an External Attentive Graph convolutional network with Positional prompts for Sequential recommendation, namely EA-GPS. Specifically, we first introduce an external attentive graph convolutional network that linearly measures the global associations among nodes via two external memory units. Then, we present a positional prompt-based decoder that explicitly treats the absolute item positions as external prompts. By introducing length-adaptive sequential masking and a soft attention network, such a decoder facilitates the model to capture the long-term positional dependencies and contextual relationships within sequences. Extensive experimental results on five real-world datasets demonstrate that the proposed EA-GPS outperforms the state-of-the-art methods. Remarkably, it achieves the superior performance while maintaining a smaller parameter size and lower training overhead. The implementation of this work is publicly available at https://github.com/ZZY-GraphMiningLab/EA-GPS.

序列推荐图神经网络轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。