轻量级推荐模型在低延迟低内存下实现长序列建模,性能超越主流方法。
Scalable Sequential Recommendation under Latency and Memory Constraints
- 用全息编码和选择性状态空间架构,线性处理序列,避免注意力爆炸。
- 10轮训练内优于SASRec,MovieLens-1M达顶尖排名,内存占用显著更低。
- 适合需要实时推荐的工业场景,支持时间打包与推理压缩扩展。
序列推荐系统需在严格内存与延迟约束下建模长期用户行为。基于Transformer的方法虽准确度高,但存在二次注意力复杂度,迫使用户历史强制截断,限制了长时序建模的实际应用。本文提出HoloMambaRec,一种轻量级序列推荐架构,结合全息降维嵌入(attribute-aware embedding)与选择性状态空间编码器(selective state space encoder),实现线性时间序列处理。物品与属性信息通过循环卷积绑定,在保持嵌入维度的同时编码结构化元数据。受近期Mamba模型启发的浅层选择性状态空间主干,支持高效训练与常数时间递归推理。在Amazon Beauty与MovieLens-1M数据集上,10轮训练预算下,HoloMambaRec超越SASRec,于MovieLens-1M达当前最佳排名,仅略逊于GRU4Rec于Amazon Beauty,且内存复杂度大幅降低。设计还集成前向兼容的时间打包与推理压缩机制,使其成为可扩展、元数据感知的实用序列推荐方案。
原文摘要 · Abstract (English)
Sequential recommender systems must model long-range user behavior while operating under strict memory and latency constraints. Transformer-based approaches achieve strong accuracy but suffer from quadratic attention complexity, forcing aggressive truncation of user histories and limiting their practicality for long-horizon modeling. This paper presents HoloMambaRec, a lightweight sequential recommendation architecture that combines holographic reduced representations for attribute-aware embedding with a selective state space encoder for linear-time sequence processing. Item and attribute information are bound using circular convolution, preserving embedding dimensionality while encoding structured metadata. A shallow selective state space backbone, inspired by recent Mamba-style models, enables efficient training and constant-time recurrent inference. Experiments on Amazon Beauty and MovieLens-1M under a 10-epoch budget show that HoloMambaRec surpasses SASRec on both datasets, attains state-of-the-art ranking on MovieLens-1M, and trails only GRU4Rec on Amazon Beauty, all while maintaining substantially lower memory complexity. The design further incorporates forward-compatible mechanisms for temporal bundling and inference-time compression, positioning HoloMambaRec as a practical and extensible alternative for scalable, metadata-aware sequential recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。