通过多粒度时间嵌入,让推荐模型更精准捕捉用户行为的时间跨度。
RoTE: Coarse-to-Fine Multi-Level Rotary Time Embedding for Sequential Recommendation

- 将时间戳分解为粗到细的多层级表示,显式建模时间间隔。
- 在三个公开数据集上提升效果,最高使NDCG@5提升20.11%。
- 轻量级模块,可无缝接入现有Transformer推荐模型。
序列推荐模型广泛用于建模用户行为。现有方法通常按时间戳排序用户交互序列,并从历史行为中学习偏好。然而,这类方法仅关注时间顺序,忽略实际交互间的时间跨度,导致对用户时间动态的表征粗糙,限制了对长期与短期兴趣演化的捕捉能力。为此,我们提出RoTE,一种新颖的多层级时间嵌入模块,显式建模序列推荐中的时间跨度信息。RoTE将每个交互时间戳分解为从粗到细的多个时间粒度,并将生成的时间表示融入物品嵌入中。该设计使模型能捕捉异构的时间模式,更好感知用户交互间的时间距离。RoTE为轻量级、即插即用模块,无需修改原有Transformer架构即可集成。我们在多个代表性模型上应用RoTE,于三个公共基准上开展实验。结果表明,RoTE持续提升基线模型性能,最高使NDCG@5提升20.11%,验证了方法的有效性与通用性。代码已开源。
原文摘要 · Abstract (English)
Sequential recommendation models have been widely adopted for modeling user behavior. Existing approaches typically construct user interaction sequences by sorting items according to timestamps and then model user preferences from historical behaviors. While effective, such a process only considers the order of temporal information but overlooks the actual time spans between interactions, resulting in a coarse representation of users' temporal dynamics and limiting the model's ability to capture long-term and short-term interest evolution. To address this limitation, we propose RoTE, a novel multi-level temporal embedding module that explicitly models time span information in sequential recommendation. RoTE decomposes each interaction timestamp into multiple temporal granularities, ranging from coarse to fine, and incorporates the resulting temporal representations into item embeddings. This design enables models to capture heterogeneous temporal patterns and better perceive temporal distances among user interactions during sequence modeling. RoTE is a lightweight, plug-and-play module that can be seamlessly integrated into existing Transformer-based sequential recommendation models without modifying their backbone architectures. We apply RoTE to several representative models and conduct extensive experiments on three public benchmarks. Experimental results demonstrate that RoTE consistently enhances the corresponding backbone models, achieving up to a 20.11% improvement in NDCG@5, which confirms the effectiveness and generality of the proposed approach. Our code is available at https://github.com/XiaoLongtaoo/RoTE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。