用双曲空间改进推荐系统中的扩散模型,更好保留物品间方向性结构。
Hyperbolic Diffusion Recommender Model
- 在双曲空间中设计定向扩散过程,适配物品的非对称结构。
- 在三个基准数据集上显著提升推荐性能,优于传统方法。
- 适合关注高阶用户-物品关系建模的研究者和工程师。
扩散模型(DMs)已成为新一代深度生成模型的代表。为深入理解扩散模型在推荐系统中的局限性,我们研究了图像与物品之间的根本结构差异。物品常表现出显著的各向异性和方向性结构,而图像中此类特征较少。然而,传统前向扩散过程持续添加各向同性高斯噪声,导致各向异性信号退化为噪声,破坏了推荐系统中的语义表示。受双曲空间进展的启发,我们提出新型超几何扩散推荐模型(HDRM)。与基于欧氏空间的方向扩散方法不同,双曲空间的内在非欧几里得结构特别适合处理各向异性扩散过程。我们首先在几何基础上形式化表征潜在的定向扩散过程;随后,提出一种专为用户与物品设计的双曲潜在扩散过程。利用双曲空间的自然几何特性,施加空间结构约束以增强扩散传播,从而确保用户-物品图的内在拓扑得以保留。在三个基准数据集上的大量实验验证了HDRM的有效性。
原文摘要 · Abstract (English)
Diffusion models (DMs) have emerged as the new state-of-the-art family of deep generative models. To gain deeper insights into the limitations of diffusion models in recommender systems, we investigate the fundamental structural disparities between images and items. Consequently, items often exhibit distinct anisotropic and directional structures that are less prevalent in images. However, the traditional forward diffusion process continuously adds isotropic Gaussian noise, causing anisotropic signals to degrade into noise, which impairs the semantically meaningful representations in recommender systems. Inspired by the advancements in hyperbolic spaces, we propose a novel \textit{\textbf{H}yperbolic} \textit{\textbf{D}iffusion} \textit{\textbf{R}ecommender} \textit{\textbf{M}odel} (named HDRM). Unlike existing directional diffusion methods based on Euclidean space, the intrinsic non-Euclidean structure of hyperbolic space makes it particularly well-adapted for handling anisotropic diffusion processes. In particular, we begin by formulating concepts to characterize latent directed diffusion processes within a geometrically grounded hyperbolic space. Subsequently, we propose a novel hyperbolic latent diffusion process specifically tailored for users and items. Drawing upon the natural geometric attributes of hyperbolic spaces, we impose structural restrictions on the space to enhance hyperbolic diffusion propagation, thereby ensuring the preservation of the intrinsic topology of user-item graphs. Extensive experiments on three benchmark datasets demonstrate the effectiveness of HDRM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。