用双曲几何提升推荐模型效率与层次建模能力
HMamba: Hyperbolic Mamba for Sequential Recommendation
- 将Mamba的高效机制与双曲几何结合,捕捉用户偏好层级
- 在四个数据集上提升3%-11%性能,保持线性时间复杂度
- 适合需要高效建模长序列偏好层次的推荐系统研究者
序列推荐系统已成为个性化服务的核心,能够通过捕捉动态交互序列来建模用户偏好的时序演化。现有方法主要依赖RNN和Transformer等传统模型。尽管在局部模式识别上表现良好,基于Transformer的方法存在二次计算复杂度和浅层注意力倾向,难以推断序列推荐数据中的长期偏好层次。近期基于Mamba的序列模型虽实现线性时间效率,但受限于欧几里得几何,未能利用推荐数据内在的双曲结构。为此,我们提出Hyperbolic Mamba,一种新架构,融合Mamba的选择性状态空间机制与双曲几何的层次表征能力。该框架引入(1)曲率感知的双曲选择性状态空间,实现对序列的双曲建模;(2)稳定化的黎曼运算,支持可扩展训练。在四个基准数据集上的实验表明,Hyperbolic Mamba在保持线性时间效率的同时,性能提升3%-11%,支持真实场景部署。本工作确立了一种高效、层次感知的序列建模新范式。
原文摘要 · Abstract (English)
Sequential recommendation systems have become a cornerstone of personalized services, adept at modeling the temporal evolution of user preferences by capturing dynamic interaction sequences. Existing approaches predominantly rely on traditional models, including RNNs and Transformers. Despite their success in local pattern recognition, Transformer-based methods suffer from quadratic computational complexity and a tendency toward superficial attention patterns, limiting their ability to infer enduring preference hierarchies in sequential recommendation data. Recent advances in Mamba-based sequential models introduce linear-time efficiency but remain constrained by Euclidean geometry, failing to leverage the intrinsic hyperbolic structure of recommendation data. To bridge this gap, we propose Hyperbolic Mamba, a novel architecture that unifies the efficiency of Mamba's selective state space mechanism with hyperbolic geometry's hierarchical representational power. Our framework introduces (1) a hyperbolic selective state space that maintains curvature-aware sequence modeling and (2) stabilized Riemannian operations to enable scalable training. Experiments across four benchmarks demonstrate that Hyperbolic Mamba achieves 3-11% improvement while retaining Mamba's linear-time efficiency, enabling real-world deployment. This work establishes a new paradigm for efficient, hierarchy-aware sequential modeling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。