解决推荐系统中序列长度与行为模式差异的难题
STAR-Rec: Making Peace with Length Variance and Pattern Diversity in Sequential Recommendation
- 用偏好感知注意力+状态空间模型融合建模用户行为
- 线性复杂度处理变长序列,提升计算效率
- 专家路由机制适配专注浏览与多品类探索两类行为
近期深度序列推荐模型在处理用户行为序列长度差异和捕捉多样化交互模式方面表现不佳。本文提出STAR-Rec,一种结合偏好感知注意力与状态空间建模的序列级混合专家架构。该方法通过:(1) 偏好感知注意力捕获物品间的固有相似性与用户多样性偏好;(2) 状态空间模型以线性复杂度高效处理变长序列;(3) 混合专家组件自适应将不同行为模式分配至专业专家,应对专注类目浏览与跨类目探索等模式。理论证明状态空间模型与注意力机制可在推荐场景自然统一:SSM通过状态压缩捕捉时序动态,而注意力建模相似与多样物品关系。在四个真实数据集上的大量实验表明,STAR-Rec在多样用户行为和变长序列场景下均显著优于现有先进方法。
原文摘要 · Abstract (English)
Recent deep sequential recommendation models often struggle to effectively model key characteristics of user behaviors, particularly in handling sequence length variations and capturing diverse interaction patterns. We propose STAR-Rec, a novel architecture that synergistically combines preference-aware attention and state-space modeling through a sequence-level mixture-of-experts framework. STAR-Rec addresses these challenges by: (1) employing preference-aware attention to capture both inherently similar item relationships and diverse preferences, (2) utilizing state-space modeling to efficiently process variable-length sequences with linear complexity, and (3) incorporating a mixture-of-experts component that adaptively routes different behavioral patterns to specialized experts, handling both focused category-specific browsing and diverse category exploration patterns. We theoretically demonstrate how the state space model and attention mechanisms can be naturally unified in recommendation scenarios, where SSM captures temporal dynamics through state compression while attention models both similar and diverse item relationships. Extensive experiments on four real-world datasets demonstrate that STAR-Rec consistently outperforms state-of-the-art sequential recommendation methods, particularly in scenarios involving diverse user behaviors and varying sequence lengths.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。